-- Logs begin at Fri 2022-06-24 02:19:10 UTC, end at Fri 2022-06-24 04:04:55 UTC. -- Jun 24 03:26:46.201002 dv-cinder-846842-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 03:26:46 2022] *** Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: nodename: dv-cinder-846842-3-smb Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: machine: x86_64 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: clock source: unix Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: pcre jit disabled Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: detected number of CPU cores: 4 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: current working directory: / Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: detected binary path: /usr/bin/uwsgi-core Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: your processes number limit is 47680 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: your memory page size is 4096 bytes Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: detected max file descriptor number: 2048 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: lock engine: pthread robust mutexes Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: thunder lock: enabled Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 03:26:46.214607 dv-cinder-846842-3-smb devstack@keystone.service[80782]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 03:26:46.256862 dv-cinder-846842-3-smb devstack@keystone.service[80782]: Python main interpreter initialized at 0x562fc5e359c0 Jun 24 03:26:46.256862 dv-cinder-846842-3-smb devstack@keystone.service[80782]: python threads support enabled Jun 24 03:26:46.256862 dv-cinder-846842-3-smb devstack@keystone.service[80782]: your server socket listen backlog is limited to 100 connections Jun 24 03:26:46.256862 dv-cinder-846842-3-smb devstack@keystone.service[80782]: your mercy for graceful operations on workers is 90 seconds Jun 24 03:26:46.257182 dv-cinder-846842-3-smb devstack@keystone.service[80782]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 03:26:46.257255 dv-cinder-846842-3-smb devstack@keystone.service[80782]: *** Operational MODE: preforking *** Jun 24 03:26:46.257589 dv-cinder-846842-3-smb devstack@keystone.service[80782]: *** uWSGI is running in multiple interpreter mode *** Jun 24 03:26:46.257589 dv-cinder-846842-3-smb devstack@keystone.service[80782]: spawned uWSGI master process (pid: 80782) Jun 24 03:26:46.257784 dv-cinder-846842-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 03:26:46.258614 dv-cinder-846842-3-smb devstack@keystone.service[80782]: spawned uWSGI worker 1 (pid: 80791, cores: 1) Jun 24 03:26:46.266033 dv-cinder-846842-3-smb devstack@keystone.service[80782]: spawned uWSGI worker 2 (pid: 80792, cores: 1) Jun 24 03:26:46.266033 dv-cinder-846842-3-smb devstack@keystone.service[80782]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 03:26:51.697574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 03:26:51.697574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: from cryptography.utils import int_from_bytes Jun 24 03:26:51.698395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 03:26:51.698395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: from cryptography.utils import int_from_bytes Jun 24 03:26:51.698806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 03:26:51.698806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: from cryptography.utils import int_from_bytes Jun 24 03:26:51.698906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 03:26:51.698906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: from cryptography.utils import int_from_bytes Jun 24 03:26:51.747054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 03:26:51.747231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 03:26:51.747319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 03:26:51.747414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 03:26:51.747488 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] command line args: [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 03:26:51.747562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] command line args: [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 03:26:51.747709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 03:26:51.747793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 03:26:51.747859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ================================================================================ {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 03:26:51.747955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ================================================================================ {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 03:26:51.748154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] admin_token = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] admin_token = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] config_dir = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] config_dir = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] config_source = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] config_source = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] debug = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.748989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] debug = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.749988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_config_append = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_config_append = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_dir = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.750992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_dir = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_file = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_file = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.751870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.752956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.753934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.754061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.754158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.754304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.754393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] publish_errors = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.755882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] publish_errors = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.756859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] standard_threads = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] standard_threads = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.757978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] use_journal = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] use_journal = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] use_json = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] use_json = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] use_stderr = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] use_stderr = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.758904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] use_syslog = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.759023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] use_syslog = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.759256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.759375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 03:26:51.759488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.759607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.759721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.759833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.759956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760813 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.760932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.761877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.762950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.763938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.764945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.765925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.766864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.767982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.768916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.769881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.770005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.770164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.770915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.771915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.772874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.773981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.774940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.775979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.776957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.777998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.778962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.779973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.780999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.781871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.782982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.783904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.external = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.784939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.password = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] auth.token = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.785892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.external = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.786954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.password = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] auth.token = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.787890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.788939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.789902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.790959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.791969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.792902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.793833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.794987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.795943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.796997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.797999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.798917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.799955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.800909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.801834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.802900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.803947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.804976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.805915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.806992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.807910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.808961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.809921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.810981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.811906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.812936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.813944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.814900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.815955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.816987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.817593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.817718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.817826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.817956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] role.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] role.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.818888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] role.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] role.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.819930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.820960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.821985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.822908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.823936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.824972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.825908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.826967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.827887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.828937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.829900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.connection = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.830963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.connection = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.831901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.832602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.833989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.834933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80792) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 03:26:51.835745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80791) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 03:26:51.864714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.864856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.864929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.865026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.865158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.865242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.873652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.873735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.902365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.902484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.902596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:51.902680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.044474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.044947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.093445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.093681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.094269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.094507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.157833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.158931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.159013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.159149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.159369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.159583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.183950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.184183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.184408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.184631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.184852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.185068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.185282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.185686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.185954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.186185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.186412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.186633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.186851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.187069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.197066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.197809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.209671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.209969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.210958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.211088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80791) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.211169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.211305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80792) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 03:26:52.228252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.228390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.228474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 03:26:52.228604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 03:26:52.228771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.228941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 03:26:52.229145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 03:26:52.229227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.229967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.230103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.230227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.241729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.241844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.242688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.250914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.251071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.254158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.254389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.254471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.255914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.256957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.257145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.257225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.257403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.257481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.257667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.283573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.284244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.285168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.285446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.285920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.286206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.290744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.291139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.291418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.291495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.291906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.292200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.298652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.298932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.299528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.299810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.303946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.304231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.304509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.304783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.304890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.305051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.305839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.306055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.306327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.306607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.306874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.325000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.325279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.326182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.326462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.329833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.331080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.333577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.334002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.334746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.335140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.338987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.340145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.342602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.343745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.346239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.346534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.346816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.347989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.348275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.349074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.349354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.368303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.368587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.368848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.369113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.369209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.369474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.369747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.370034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.376945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.377918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.378687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.378962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.379650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.379929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.382202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.382480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.382752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.383026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.383260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.383340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.383565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.383868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.384175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.384491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.396512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.396787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.397072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.397349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.397682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.397998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.398293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.398575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.398853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.399146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.399436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.400071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.400366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.400659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.417646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.418899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.420922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.422206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.424225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.425486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.425974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.427830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.428190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.428467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.428746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.429473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.429752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.430064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.436213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.437350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.437824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.438990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.441054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.441340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.441722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.442049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.442267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.442557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.442942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.443221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.451232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.451519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.451804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.452249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.452537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.452819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.459686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80791) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.459963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.460239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.460511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.460780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80792) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 03:26:52.460862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.461907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.462842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80791) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.463848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.464123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.464391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80792) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 03:26:52.502251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fc5e359c0 pid: 80791 (default app) Jun 24 03:26:52.503044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562fc5e359c0 pid: 80792 (default app) Jun 24 03:26:52.505627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663e3b-2087-4048-bab9-5a124a1fac04 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:26:52.505955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663e3b-2087-4048-bab9-5a124a1fac04 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:26:52.506236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663e3b-2087-4048-bab9-5a124a1fac04 None None] PATH_INFO: `/v3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:26:52.510395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Fri Jun 24 03:26:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:00.945914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:00.946484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:00.946484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:00.950790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:00.956201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:00.956627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:00.956754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:01.026656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: INFO dbcounter [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] Registered counter for database keystone Jun 24 03:27:01.047395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG oslo_db.sqlalchemy.engines [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80791) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 03:27:01.054072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writer thread running {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 03:27:01.235239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG passlib.handlers.bcrypt [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80791) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 03:27:01.235572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG passlib.handlers.bcrypt [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80791) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 03:27:01.290441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:01.292086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:01.415281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 03:27:01.570124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:01.641974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: INFO dbcounter [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] Registered counter for database keystone Jun 24 03:27:01.661349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG oslo_db.sqlalchemy.engines [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80792) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 03:27:01.667580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writer thread running {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 03:27:01.787446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf5d29-901b-44ef-b496-14ed8da7dde5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:01.791823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:01.792489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:01.792779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:01.793058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:01.801215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:01.852970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 03:27:01.853324 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b1e9-dfcc-4161-9dd2-b332af533fa9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:01.863140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 03:27:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:27:01.869587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:01.884773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5734ffd3-93ea-472f-a979-32e5089ec6a5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:01.889342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:01.890517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:01.890807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:01.891086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] PATH_INFO: `/v3/projects/dc8d9d26aed04d1b8b0e31128b902112` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:01.892570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] RBAC: Authorizing `identity:get_project(project_id=dc8d9d26aed04d1b8b0e31128b902112)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:01.945798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 03:27:01.946162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50212ff-403f-4fd1-9ba0-ecd96bf9c743 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:01.950701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Fri Jun 24 03:27:01 2022] GET /identity/v3/projects/dc8d9d26aed04d1b8b0e31128b902112 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:03.965832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-b81b-4913-9659-5e42b31f484f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:03.966383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-b81b-4913-9659-5e42b31f484f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:03.966477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39622b0d-b81b-4913-9659-5e42b31f484f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:03.970564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:03.976457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:03.976873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:03.977057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:03.995763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:03.997280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:04.005160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 03:27:04.027687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622b0d-b81b-4913-9659-5e42b31f484f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:04.040380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39622b0d-b81b-4913-9659-5e42b31f484f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:04.044617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:04.045243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:04.045530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:04.045810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:04.053532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:04.055458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b98e10-6865-4f99-b204-fe68650137a2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:04.064156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Fri Jun 24 03:27:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:27:04.069548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:04.078394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0267a56-7c6b-4d2f-bd22-e3aa50523d41 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:04.083239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:04.084087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:04.084368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:04.084642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:04.086086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:04.087892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9cad2c-62cc-4575-ad99-e1f99f1886ad admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:04.089439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Fri Jun 24 03:27:04 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:06.155978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab055-700e-418c-8f11-15e9b597429a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.156499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab055-700e-418c-8f11-15e9b597429a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.156589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbab055-700e-418c-8f11-15e9b597429a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.157902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:06.163075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.163500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.163762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.180229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:06.181402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:06.187351 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f28a-595d-48db-8297-3dfed51f56f1 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.187642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f28a-595d-48db-8297-3dfed51f56f1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.187917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e74f28a-595d-48db-8297-3dfed51f56f1 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.189264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:06.194931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.195222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.195564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.234786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG passlib.handlers.bcrypt [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80792) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 03:27:06.235198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG passlib.handlers.bcrypt [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80792) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 03:27:06.263732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:06.281252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:06.282890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:06.286527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.310656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.383870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:06.389104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12a6e4-09b7-44de-91c5-93c03d351797 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.405529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.422458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.423273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.423566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.423852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.435868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:06.447657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:06.448743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:06.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:06.454621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.506498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58960fd5-6d9a-4f48-9704-e4208c29270b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.509520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.536791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.545718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.546641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.546934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.547214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.553972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743760e2-0528-40cd-80a1-56422e7ed944 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.587562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.588228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.588520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.588801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.589555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:06.589900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:06.591316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:06.603593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:06.609205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.616909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:06.618475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:06.707465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e15d4-5f3f-4b99-83df-3e391f413da8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.716049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:27:06.721578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.724322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.742442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.743349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.743630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.743902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.745344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:06.746593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:06.748237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:06.753616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.767704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.818718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a383-3215-4cce-b2b1-16bef3d734ce None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.851606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd263650-5b2d-4a6f-bed8-60fc7eb9facd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:06.852009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.852797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.853084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.853354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.871740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:06.873207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:06.884919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:06.885701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:06.886024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:06.886308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:06.887486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:06.888893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:06.890535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:27:06.896205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:06.897058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:06.897842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:27:06.897842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:27:06.897842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:27:06.897842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:06.898112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.898187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:06.902806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:06.957422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.977968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:06.997435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4381216-e274-42a6-812d-f2861d085587 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:07.003224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac6de-91b0-4070-852a-db7889526875 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:07.032464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:07.033115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:07.033399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:07.033679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:07.034532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.domain.id=default, user.id=2caa6cb9210e46f2a79af594aec8b818) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:07.034842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:07.036308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc5345-8270-4a8c-8833-826f092334b7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:07.036886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:07.037547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:07.037836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:07.038142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:07.038863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:07.039173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:07.040538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2425-0ef7-4fa7-af78-8f28f2d545f0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:07.042937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/role_assignments?user.id=2caa6cb9210e46f2a79af594aec8b818&scope.domain.id=default&role.id=20658940146144b9b9afa747f31d7a5d => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:07.059859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:09.468549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911e4c-e399-4783-8ef7-5e3495d4cc0f None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.470083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911e4c-e399-4783-8ef7-5e3495d4cc0f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.470804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce911e4c-e399-4783-8ef7-5e3495d4cc0f None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.473069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:09.478524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56edc1-6301-4109-b85a-076dbbaf02cc None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.479342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56edc1-6301-4109-b85a-076dbbaf02cc None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.479815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56edc1-6301-4109-b85a-076dbbaf02cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.506871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ff56edc1-6301-4109-b85a-076dbbaf02cc None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:09.508429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ff56edc1-6301-4109-b85a-076dbbaf02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:09.594301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:09.633574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce911e4c-e399-4783-8ef7-5e3495d4cc0f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:09.678289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda0ce-7506-4a0f-85e7-811c55f4a627 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.678900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda0ce-7506-4a0f-85e7-811c55f4a627 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.679376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda0ce-7506-4a0f-85e7-811c55f4a627 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.681262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:09.686144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182fb66-51a9-4d87-aa64-01543ad430c0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.686655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182fb66-51a9-4d87-aa64-01543ad430c0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.687128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182fb66-51a9-4d87-aa64-01543ad430c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.718967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b182fb66-51a9-4d87-aa64-01543ad430c0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:09.720507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b182fb66-51a9-4d87-aa64-01543ad430c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:09.794360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:09.811620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce911e4c-e399-4783-8ef7-5e3495d4cc0f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:09.827511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:09.828840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe89d-551a-4ecd-a849-b15a574792d5 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.829130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe89d-551a-4ecd-a849-b15a574792d5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.829407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affe89d-551a-4ecd-a849-b15a574792d5 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.830705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:09.838696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67d0b-970b-4d72-b8bc-33bbe7da4113 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.838991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67d0b-970b-4d72-b8bc-33bbe7da4113 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.839268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b67d0b-970b-4d72-b8bc-33bbe7da4113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.871769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-45b67d0b-970b-4d72-b8bc-33bbe7da4113 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:09.872967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-45b67d0b-970b-4d72-b8bc-33bbe7da4113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:09.886963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:09.887765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.888082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.888376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.899848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:09.907713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:09.908565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:09.909282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 13/27] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:09.909907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:09.914438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:09.965631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:09.967847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da836b-bc0a-4cb9-b0ee-efb9eea086d7 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:09.968268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da836b-bc0a-4cb9-b0ee-efb9eea086d7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:09.968618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da836b-bc0a-4cb9-b0ee-efb9eea086d7 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:09.970325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 16/29] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:09.975191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da836b-bc0a-4cb9-b0ee-efb9eea086d7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.047466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b45250-2a79-4cd5-b79a-80e8538e7ef8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.095264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.096057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.096500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.096912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.098275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da836b-bc0a-4cb9-b0ee-efb9eea086d7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.107868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.116789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.118464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.135736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.136720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.137232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.137706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.138692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:10.139209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d7b6a3e5-5cbc-4e3e-b892-43c51a0bbbac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:27:10.140044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:10.140799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:10.141619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:27:10.141619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:27:10.141619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:27:10.141619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:10.141619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 14/30] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:10.142554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.142719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.142999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.143916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.163011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 17/31] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:10.164189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.175884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:10.177157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:10.245310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.265712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 15/32] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:10.266432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.277599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2a958-4c47-4c20-8c8c-91622b6d9650 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.314518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.315545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.316028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.316518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.318052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.319729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.385377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3effd76-ba4e-4a0b-9f9c-8d3c362ebf2b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.425505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.427171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.427619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.428173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.429068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:10.429537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.431107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.449474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:10.450640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.501074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.540285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 18/34] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 03:27:10 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:10.541249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.570844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4e7e2-6df9-47c3-aac9-fb0bd05e5e49 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.584633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.609828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.610826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.611191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.611531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.612817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.615246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.617013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 17/35] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:10 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:10.617781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.673734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e9338-21fe-421c-80fa-c441d644ac69 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.715010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.716111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.716553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.716976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.717942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.719725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.731851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e721-b1b6-4752-9dc9-cf56d707d368 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:10.753799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.780378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:10.781103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:10.781458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:10.781739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:10.782557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:10.784200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:10.812031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 19/36] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 03:27:10 2022] POST /identity/v3/roles => generated 219 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:10.812998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:10.933938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:10.950294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9f2c6-48e1-479a-ae27-3dec2b74d1ef None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:11.006098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:11.006098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.006098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.006098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.006456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:11.006983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a46444-1c34-4927-b3e0-3905731236cb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:11.009138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 20/37] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:11.010609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdf48-80a5-4bb0-99d8-586161c53738 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.010902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdf48-80a5-4bb0-99d8-586161c53738 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.011180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdf48-80a5-4bb0-99d8-586161c53738 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.012600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 21/38] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:11.019952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592705c-cabb-4cce-95ec-138cef792f84 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.020995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592705c-cabb-4cce-95ec-138cef792f84 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.020995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592705c-cabb-4cce-95ec-138cef792f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.050773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0592705c-cabb-4cce-95ec-138cef792f84 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:11.052952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0592705c-cabb-4cce-95ec-138cef792f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:11.124447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 18/39] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:27:10 2022] POST /identity/v3/projects => generated 301 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:11.125412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:11.138244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 22/40] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:11.140004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd81b7-18cf-434e-b785-c1f22dc40015 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.140484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd81b7-18cf-434e-b785-c1f22dc40015 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.140768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd81b7-18cf-434e-b785-c1f22dc40015 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.145899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 23/41] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:11.147543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.147835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.148164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.165697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:11.166959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:11.244581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7244-e26b-49bd-b01e-44b92a1b603b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:11.261357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 24/42] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:11.262733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:11.282784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:11.283781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.284074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.284363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] PATH_INFO: `/v3/domains/default/users/2caa6cb9210e46f2a79af594aec8b818/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.288089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2caa6cb9210e46f2a79af594aec8b818, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:11.289686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:11.293362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:11.378024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73409fd-3dec-493d-a6ac-88db5bc6fd7d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:11.384029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 19/43] 10.222.0.42 () {58 vars in 1361 bytes} [Fri Jun 24 03:27:11 2022] PUT /identity/v3/domains/default/users/2caa6cb9210e46f2a79af594aec8b818/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:11.388938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:11.418222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:11.418931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.419221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.419513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.420526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:11.421777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:11.423364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:11.482857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 25/44] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 03:27:11 2022] POST /identity/v3/roles => generated 223 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:11.508997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0fb1d-fad9-40d9-8f90-57aa0420633d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:11.556995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:11.558195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.558669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.558959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.560244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:11.561743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644de1e0-2fad-41b7-bf23-e3cc4904363b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:11.563478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 20/45] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:11.569936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:11.657447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:11.681326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388bfd3-ba92-4a79-99fa-d84cef0f7461 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:11.717078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:11.717758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:11.718084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:11.718378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:11.719117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:11.720663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d01d4-0dc2-44ac-9efb-cea52745df7e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:11.802834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 26/46] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:27:11 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:13.433691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02798-492f-40a8-8e2c-3284d22f32c9 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.434228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02798-492f-40a8-8e2c-3284d22f32c9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.434308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b02798-492f-40a8-8e2c-3284d22f32c9 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.435671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 21/47] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:13.441038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.441439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.441610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.459174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:13.460368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:13.525843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 27/48] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:13.548647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b02798-492f-40a8-8e2c-3284d22f32c9 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:13.643477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:13.651632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b02798-492f-40a8-8e2c-3284d22f32c9 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:13.685728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:13.686476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.686768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.687049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.698092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-fca6604c-01b2-44f3-94dd-926342a1a7ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:13.705618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:13.706621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:13.707381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 22/49] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:13.713318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:13.771072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:13.805453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f283-9205-4334-9f43-7f19d13e1f76 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.805753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f283-9205-4334-9f43-7f19d13e1f76 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.806068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0f283-9205-4334-9f43-7f19d13e1f76 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.807466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 23/50] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:13.812209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14953-6a95-4b00-993c-ab05f25cf4e4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:13.812327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.812551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.812834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.830911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:13.832505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:13.904649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 24/51] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:13.928457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:13.952843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:13.953452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:13.953746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:13.954077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:13.954836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:13.955153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:13.956542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:13.964699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:13.970136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:14.015426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:14.030551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fef0c-9ada-4488-a009-3b62940810db None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:14.064405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:14.065203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:14.065494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:14.065776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:14.067583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:14.069081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:14.070768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 25/53] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:14.070862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38115573-a44a-40b4-8df8-c0b4e2cbc750 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:14.076107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:14.095865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:14.109640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:14.110545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:14.110833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:14.111112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:14.112530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:14.114922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:14.116543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:13 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:14.121878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:14.174378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75acfb0-b08a-4bd5-bf36-bc262f0e7fd6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:14.208451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:14.209037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:14.209322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:14.209598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:14.210347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:14.211847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc992db-edcc-48c2-b170-5cd7fec18397 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:14.223053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897b4a3-943f-494f-9196-2efb8c18d063 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:14.256954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:14.257744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:14.258072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:14.258356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:14.259542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:14.260980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:14.262637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 30/55] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:14.268313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:14.321773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:14.365966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31627078-35ad-4c50-93e9-c0049b12ba32 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:14.369488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 26/56] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 03:27:14 2022] POST /identity/v3/projects => generated 298 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:14.401721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:14.402432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:14.402721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:14.403007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:14.403867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.domain.id=default, user.id=2caa6cb9210e46f2a79af594aec8b818) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:14.404187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:14.405675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b8a76-d586-4e50-844b-4fc026d37800 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:14.416434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 31/57] 10.222.0.42 () {56 vars in 1322 bytes} [Fri Jun 24 03:27:14 2022] GET /identity/v3/role_assignments?user.id=2caa6cb9210e46f2a79af594aec8b818&scope.domain.id=default&role.id=20658940146144b9b9afa747f31d7a5d => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:16.397871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6920d-d4b7-4eac-8171-131aa20e72bd None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:16.398374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6920d-d4b7-4eac-8171-131aa20e72bd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:16.398455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6920d-d4b7-4eac-8171-131aa20e72bd None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:16.399812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 27/58] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:16.404988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:16.405417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:16.405557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:16.421840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:16.423064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:16.487564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 32/59] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:16.512227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6920d-d4b7-4eac-8171-131aa20e72bd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:16.516001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:16.617751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6920d-d4b7-4eac-8171-131aa20e72bd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:16.652749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:16.653467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:16.653757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:16.654050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:16.655243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:16.656700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d337f-034b-4049-99d5-587676b1977d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:16.658518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 28/60] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:16.664049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:16.714054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:16.768022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d2816-67dc-4dac-8b2b-d5aa1d15ebba None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:16.800679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:16.801958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:16.802258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:16.802541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:16.803269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:16.804732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5750774-a0c2-4858-a4d3-d459e77b9a6a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:16.892069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 33/61] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:16 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:19.996916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928f3a-e6f7-43a4-883b-dc69815c7734 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:19.997803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928f3a-e6f7-43a4-883b-dc69815c7734 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:19.998814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3928f3a-e6f7-43a4-883b-dc69815c7734 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.000006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 29/62] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:20.005780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af8b-f06b-4537-a431-bac28e22b642 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.006226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af8b-f06b-4537-a431-bac28e22b642 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.006409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1af8b-f06b-4537-a431-bac28e22b642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.034144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-12f1af8b-f06b-4537-a431-bac28e22b642 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:20.035380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-12f1af8b-f06b-4537-a431-bac28e22b642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:20.132216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 34/63] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:20.172590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928f3a-e6f7-43a4-883b-dc69815c7734 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.279006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.292305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d290-454d-4441-a544-db3fc7150f6a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.304764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d290-454d-4441-a544-db3fc7150f6a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.304764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d290-454d-4441-a544-db3fc7150f6a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.304764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 35/64] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:20.307063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e47-c313-4cd1-855e-f14ebe613503 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.307592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e47-c313-4cd1-855e-f14ebe613503 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.308095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e8e47-c313-4cd1-855e-f14ebe613503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.326833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-190e8e47-c313-4cd1-855e-f14ebe613503 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:20.328375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-190e8e47-c313-4cd1-855e-f14ebe613503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:20.328834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3928f3a-e6f7-43a4-883b-dc69815c7734 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:20.365888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.393862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:20.395380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.395875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.396355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.410356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:20.413835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:20.415337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0c04-5f96-4d68-890b-9261e249954d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.417414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0c04-5f96-4d68-890b-9261e249954d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.417414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0c04-5f96-4d68-890b-9261e249954d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.417414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 37/66] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:20.424319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:20.425137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:20.425910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:20.428755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6a49-3cc2-4702-bc8a-abb602aacbe3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.429242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6a49-3cc2-4702-bc8a-abb602aacbe3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.429709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6a49-3cc2-4702-bc8a-abb602aacbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.432472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 30/67] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:20.446859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.453067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-62bb6a49-3cc2-4702-bc8a-abb602aacbe3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:20.454457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-62bb6a49-3cc2-4702-bc8a-abb602aacbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:20.528733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 38/68] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:20.531738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a803e-70d8-4439-ba02-7047e7f814a9 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.532262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a803e-70d8-4439-ba02-7047e7f814a9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.533128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a803e-70d8-4439-ba02-7047e7f814a9 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.534989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 39/69] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:20.539538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a803e-70d8-4439-ba02-7047e7f814a9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.562314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d383a-6f20-4f62-acab-bcae3b88195c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:20.593323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.598539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:20.599208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.599493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.599769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.600581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:20.600894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:20.602308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf6097c-148c-44e6-b04e-4f018cddb623 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:20.610923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 31/70] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:20.611919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.612208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.612567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.630189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:20.631407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:20.640440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.647030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a803e-70d8-4439-ba02-7047e7f814a9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:20.679918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:20.680708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.680991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.681268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.693139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:20.697065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 32/71] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:20.697916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-4d8246d3-3248-493b-ba3f-0b6343f204b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:20.702215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:20.703059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:20.703808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 40/72] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:20.704775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f75dd-8731-4a8f-9b5a-5aa3cd85f8bd None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.705075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f75dd-8731-4a8f-9b5a-5aa3cd85f8bd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.705357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f75dd-8731-4a8f-9b5a-5aa3cd85f8bd None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.709963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 41/73] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:20.709963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f75dd-8731-4a8f-9b5a-5aa3cd85f8bd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.800302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281973-e379-415f-b854-561c7b76efc8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:20.812732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f75dd-8731-4a8f-9b5a-5aa3cd85f8bd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:20.825346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.835722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:20.836534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.836820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.837100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.846011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361873a2-6622-467f-a754-8adf865960ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:20.846879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:20.846985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361873a2-6622-467f-a754-8adf865960ce None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.847167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361873a2-6622-467f-a754-8adf865960ce None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.847449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361873a2-6622-467f-a754-8adf865960ce None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.849145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361873a2-6622-467f-a754-8adf865960ce None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:20.850642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361873a2-6622-467f-a754-8adf865960ce None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:20.852309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 42/74] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:20.853063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361873a2-6622-467f-a754-8adf865960ce None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d31034f1-1a90-4a6c-86b2-129cf0dfa3be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:20.855719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:20.856675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:20.857423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 33/75] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:20.862087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:20.862734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:20.863024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:20.879858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:20.881046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:20.881986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:20.947487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 34/76] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:20.948771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:20.963200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361873a2-6622-467f-a754-8adf865960ce None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.000317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.000999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.001286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.001563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.002363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:21.002671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.004061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.012368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 43/77] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.013146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.057646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf7cea-e640-47cf-b055-b9d31aceae5b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.071158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.090398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.103433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.103433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.103433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.103433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.103720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.103788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.103788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 35/78] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.103788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.109277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903aec6e-3db6-4ae3-8ca8-bad370aba00c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.142578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.143271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.143559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.143837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.196486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc4dbf-f8e9-48ea-a4a5-6666dbd53c40 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.210381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.211842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.230140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.230807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.231098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.231382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.232131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:21.232444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.233803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.241838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 36/79] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.242726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.287179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.298949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.314090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 44/80] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:21.314820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.342552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f638267c-3577-4527-91d5-a84420dd061f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.377063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.377885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.378173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.378462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.388733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:21.396894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:21.397721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:21.398508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 37/81] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:21.399380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.412246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b76822-d6e4-4837-a989-e92c2f2a15c7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.446937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.447809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.448097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.448385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.463676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.465158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.467041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 45/82] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.467728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.505675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2461f-bda2-4fbb-8227-6ebddefa9d85 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.508025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.514485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.538126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.538811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.539399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.539856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.540899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.542392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.566569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e199e-5f5f-4569-8f94-b755d1965d0f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.601458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.602357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.602647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.602927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.604118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.605565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.607231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 46/83] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.611434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.665145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 38/84] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:21 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:21.666017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.721361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f55d1-f66d-4508-83f4-5921006edbc6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.737706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.766481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.767661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.767947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.768328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.769783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.771807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.774134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 47/85] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.774945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.781554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd2195-3cf4-4444-8db3-dc626ed481a3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.825236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.825921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.826165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.826447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.827200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:21.827509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:21.828895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:21.837710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 39/86] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:21.838439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:21.869674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:21.892811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85268a-7090-40a9-87de-22e33477f22a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:21.937656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:21.938374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:21.938666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:21.938944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:21.963548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a9a1-73d0-40de-83a0-8fecc7489e78 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.006240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.007149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.007581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.008012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.011143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.036424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.038143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.099210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.101243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.132858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.158156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 48/87] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:22.159264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.237844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 40/88] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:22.239224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.268617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.290994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10fea5c-4166-406c-80ca-c17d731a1f03 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.329098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.329678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.330008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.330302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.331159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=2caa6cb9210e46f2a79af594aec8b818) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:22.331484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.333720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.340188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 49/89] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/role_assignments?user.id=2caa6cb9210e46f2a79af594aec8b818&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:22.341048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.346384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1c5a9-95a2-4606-8e89-bc7bc7c0f8b8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.373041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.386912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.389976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.389976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.389976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.389976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.391942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.393938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 41/90] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:22.394998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.519190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c72c40-3a41-4f7d-be5b-3ce621b393aa None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.532608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7d897-5139-42b1-a26d-521e84c2ab8c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.557132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.558010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.558309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.558603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.559867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.561477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.563552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 50/91] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:22.573903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.597886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.604169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.605358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.605824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.606301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.607756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.609463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.611523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 42/92] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:22.612564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.676435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.687359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68888f-4d89-4f38-8dc8-49b30e1c2d8e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.721486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8b47a-587a-405b-b33b-42cbf4e2e712 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.729902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.729902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.729902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.729902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.766735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.767796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.768278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.768748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.769926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:22.770515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.772170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.778329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 43/93] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:22.779436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:22.821213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.822789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.849448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.890795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d02e3-bbd0-4022-aba5-3336cf55263f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:22.915009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:22.928182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:22.928999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:22.929293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:22.929597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:22.930608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:22.931001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:22.932592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:22.938835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 44/94] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:23.032389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 51/95] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:23.038868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:23.177385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b194def-a356-4f7b-97ca-b1fb2a89927c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:23.227652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:23.228452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:23.228739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:23.229017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] PATH_INFO: `/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:23.230286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] RBAC: Authorizing `identity:get_project(project_id=7f5fec9330724ee7a9ffad6457bd6ba9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:23.231759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abfe7c-cb6b-45e7-af70-5d2aa26d0a1f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:23.233803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 45/96] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:23 2022] GET /identity/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:23.239586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:23.374973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e772cb-fe9c-4ead-87e0-da681a761143 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:23.390256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:23.419462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:23.420130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:23.420420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:23.420702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:23.421543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=7f5fec9330724ee7a9ffad6457bd6ba9, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:23.421878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:23.423330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73173969-3f9d-4c08-9b52-7d6abbbd40b3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:23.433925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 52/97] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:23 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=7f5fec9330724ee7a9ffad6457bd6ba9&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:24.536816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b93-3b36-42dd-a48f-43b3c53eda06 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:24.537319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b93-3b36-42dd-a48f-43b3c53eda06 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:24.537427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f607b93-3b36-42dd-a48f-43b3c53eda06 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:24.538783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 46/98] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:24.543970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:24.544382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:24.544568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:24.562192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:24.563400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:24.576383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0570-75e8-41fa-bf2f-e1acae604797 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:24.576677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0570-75e8-41fa-bf2f-e1acae604797 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:24.576960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d0570-75e8-41fa-bf2f-e1acae604797 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:24.578375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 47/99] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:24.584621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:24.584911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:24.585189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:24.607870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:24.609085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:24.712479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 53/100] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:24.712660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:24.752501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 48/101] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:24.780050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:24.792284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:24.986593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab66b49-66ba-48b2-a8aa-17793dec382e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.017490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.042381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35e177-a254-4947-91e8-a01293557d65 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.049012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.049832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.050149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.050431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.066917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-22f83965-4b26-4893-b008-e3bed26e7e94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:25.074882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:25.075701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:25.076449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 54/102] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:25.077410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0054-29dd-478c-ab2e-17e2940d90cb None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.077709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0054-29dd-478c-ab2e-17e2940d90cb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.082081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c0054-29dd-478c-ab2e-17e2940d90cb None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.083929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 55/103] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:25.085765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c0054-29dd-478c-ab2e-17e2940d90cb None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.092699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.093700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.094164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.094576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.095997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.105877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc5aa3e-2ac6-474c-8299-35105eab1cef None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.107785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 49/104] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:25.109204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.109632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.110110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.139811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:25.141208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:25.193631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c0054-29dd-478c-ab2e-17e2940d90cb None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.230133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.230819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.231161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.231446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.235077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:25.235077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.235077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.243227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 56/105] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:25.244089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.258223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.267550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 50/106] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:25.268535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.276017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.351164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf208-9888-4b92-a740-287ca0278077 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.387655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.388394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.388684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.388966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.389746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.391242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.455411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0bfe68-9317-4979-b2d9-2d6b53843331 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.472094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 57/107] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:27:25 2022] POST /identity/v3/projects => generated 302 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:25.473677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.529616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.530768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.531061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.531341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] PATH_INFO: `/v3/users/56777341df2c4cab844262a96a2f81fe` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.565331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] RBAC: Authorizing `identity:get_user(user_id=56777341df2c4cab844262a96a2f81fe)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.567457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.569238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 51/108] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:25 2022] GET /identity/v3/users/56777341df2c4cab844262a96a2f81fe => generated 289 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:25.575135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.647034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.692277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.699139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0629b-0c1f-41bf-a8d1-71aa4c0751ac None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.768827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.769598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.770452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.770771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.783671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c8d1032b-0b5c-44fe-8566-3537a3168385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:25.794235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:25.795294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:25.796221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:25.798132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 58/109] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:25.800294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb9ac-578b-4f0f-87df-0d35fb825158 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.800594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359a519-ad77-4541-9de9-868d804ae267 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.800908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb9ac-578b-4f0f-87df-0d35fb825158 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.801788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625eb9ac-578b-4f0f-87df-0d35fb825158 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.803882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 59/110] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:25.804505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eb9ac-578b-4f0f-87df-0d35fb825158 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:25.840752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.841888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.842376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.842868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.919861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.920985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625eb9ac-578b-4f0f-87df-0d35fb825158 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:25.921916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.958592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:25.959286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.959582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.959866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.960734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:25.961056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:25.962667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d68997-85f1-4596-90bd-4d46fecee1fa None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:25.978087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:25.979034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 60/111] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:25.980652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:25.980954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:25.981242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:25.986961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.005938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:26.007770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:26.041299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 52/112] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:26.042529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.082302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 61/113] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:26.083808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.151285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563c6bd-443a-4a4b-a990-47520a9cc45e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.189664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.191013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.191540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.192479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.193868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.195275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08d2c6c-ab61-4dc6-b934-832ca32ea45f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.195724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.197827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 53/114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:26.198827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.210841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.230403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.235426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.236397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.236603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.236890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.238209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.240081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.241880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 62/115] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:26.242855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.313299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb57ae-e2d2-4c84-85c4-7acf05bbde71 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.351020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.352315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.352826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.353297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.358501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8015-7dab-49a4-b72d-667552eb79f1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.364963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1e190d14-08b9-4d17-b33c-adbd26b42945 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:26.373325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:26.374396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:26.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:26.377555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 54/116] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:26.379046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71731-ddf5-4c5e-b453-73ff7a132352 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.380145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71731-ddf5-4c5e-b453-73ff7a132352 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.380644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc71731-ddf5-4c5e-b453-73ff7a132352 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.382251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 55/117] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:26.383152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71731-ddf5-4c5e-b453-73ff7a132352 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.397070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.398150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.398445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.398731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.400029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.401631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e95850-6cd2-4394-b031-eacceea0763e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.403615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 63/118] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:26.404947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.405297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.405735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.424047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:26.425403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:26.459674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.496796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.499393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc71731-ddf5-4c5e-b453-73ff7a132352 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.502569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 64/119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:26.503537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.548923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.550006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.550557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.551087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.552650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=56777341df2c4cab844262a96a2f81fe) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:26.553166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.555089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.561525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 56/120] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/role_assignments?user.id=56777341df2c4cab844262a96a2f81fe&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=904a0ab8599949a18674c75cf7605e5d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:26.562560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.619025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20454a-0f44-4e3b-bf69-1d02162df860 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.662002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.662767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.663046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.663332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.664423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:26.664539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.665950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.675927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 65/121] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:26.677461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.682566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc22d1-59c3-4942-9fd1-d884a326267d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.717461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.723935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.724312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.724605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.724891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/2caa6cb9210e46f2a79af594aec8b818/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.726970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, user_id=2caa6cb9210e46f2a79af594aec8b818, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:26.733906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefa300c-794f-4fd3-83f5-f9f59fc60a21 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:26.749727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:26.793074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb84c5e-fa58-4780-93ee-2837c672ba4f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:26.819139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 57/122] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:26 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/2caa6cb9210e46f2a79af594aec8b818/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:26.821025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb54c-f245-40b1-88d4-b9f4f99ef0e5 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.821653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb54c-f245-40b1-88d4-b9f4f99ef0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.822183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bb54c-f245-40b1-88d4-b9f4f99ef0e5 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.823811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 58/123] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:26.824906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bb54c-f245-40b1-88d4-b9f4f99ef0e5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:26.837153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:26.838424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.838989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.839438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.855339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-02bacc69-8a7b-4ecb-a514-b7705bedada4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:26.872077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:26.873027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:26.873797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:26.876820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 66/124] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:26.878882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:26.879458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:26.880012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:26.901823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:26.903625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:27.004009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 67/125] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:27.005329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.048806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bb54c-f245-40b1-88d4-b9f4f99ef0e5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.062286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.086880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.087779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.088069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.088350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.089582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.091093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.092757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 59/126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:26 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.093534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.120237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b8fcd-4feb-4c01-b1e5-7ee71409ab90 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.157878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.158770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.159172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.159615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.160520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:27.160979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.162519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.171574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 68/127] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.172117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.172763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.207121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb675b-15a6-4610-883d-73b6704bab88 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.281321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.282067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.282355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.282635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.311229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:27.331333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:27.332466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:27.333402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 60/128] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:27.334121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.357733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a5472-2f08-470d-831b-63e9035173c2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.373567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.397302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f175-769e-477b-ad86-548b45771877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.398458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f175-769e-477b-ad86-548b45771877 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.399277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f175-769e-477b-ad86-548b45771877 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.399705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1084f175-769e-477b-ad86-548b45771877 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.401275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084f175-769e-477b-ad86-548b45771877 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.402909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1084f175-769e-477b-ad86-548b45771877 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.404771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 69/129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.405965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f175-769e-477b-ad86-548b45771877 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.525982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1084f175-769e-477b-ad86-548b45771877 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.564030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.564921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.565377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.565797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.567524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:27.567981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.569170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a13c1-02c2-46a2-8c97-b164c86b8cbf None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.569648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.579455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 70/130] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.580387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.626220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.628989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.654717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.655652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.655942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.656218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.657963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.659416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.670300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 61/131] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.671216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.694213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0264e38-eba7-4d9f-8459-a71bc8f6778a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.733370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.734642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.735237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.735662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/1714c86967334b0cba5e44e8951a3b7f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.737841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, user_id=1714c86967334b0cba5e44e8951a3b7f, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.740373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.819416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd4b96-9d2b-4961-821f-8cb1a0ee07e0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:27.856770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:27.857643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:27.858156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:27.858454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:27.859794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:27.861523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:27.864004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 62/132] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:27.864826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.876377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 71/133] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:27 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/1714c86967334b0cba5e44e8951a3b7f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:27.877420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:27.931534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:27.981103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb0321-a06c-47a8-b30a-7d6ffdfc3ef6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:28.021160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:28.022087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.022425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.022761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.024006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:28.025478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:28.034298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 63/134] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:28.034298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:28.122492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc8df5-6aff-4a58-b6fb-cc3c01494dd9 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:28.125248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:28.142910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691e7cb-5a88-4c21-b88b-fc477dafdf39 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:28.171148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:28.171846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:28.172028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.172318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.172600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] PATH_INFO: `/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.174577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] RBAC: Authorizing `identity:get_project(project_id=7f5fec9330724ee7a9ffad6457bd6ba9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:28.176049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:28.178486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 72/135] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:27 2022] GET /identity/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:28.179578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:28.180529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.180998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.181286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/1714c86967334b0cba5e44e8951a3b7f/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.183625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, user_id=1714c86967334b0cba5e44e8951a3b7f, role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:28.185149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04af8d-dbc3-4de0-becb-df4d2a03d9d4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:28.186738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:28.272795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:28 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/1714c86967334b0cba5e44e8951a3b7f/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:27:28.310761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae5cfa-387f-4b5c-bc3e-e1423bd86470 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:28.348810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:28.349724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.350039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.350322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] PATH_INFO: `/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9/users/1714c86967334b0cba5e44e8951a3b7f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.352397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] RBAC: Authorizing `identity:create_grant(project_id=7f5fec9330724ee7a9ffad6457bd6ba9, user_id=1714c86967334b0cba5e44e8951a3b7f, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:28.353900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc8023-c223-4c93-897b-08b2e7228a9c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:28.439547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 73/137] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:28 2022] PUT /identity/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9/users/1714c86967334b0cba5e44e8951a3b7f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:28.594145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44d0d-de8f-4d79-995b-995ab26d7c0d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.594525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44d0d-de8f-4d79-995b-995ab26d7c0d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.594816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be44d0d-de8f-4d79-995b-995ab26d7c0d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.596206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 65/138] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:28.602187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.602484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.602774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.627156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:28.628404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:28.660352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:28.718214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 74/139] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:28.747852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be44d0d-de8f-4d79-995b-995ab26d7c0d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:28.855879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be44d0d-de8f-4d79-995b-995ab26d7c0d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:28.890632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:28.891436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:28.891723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:28.891996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:28.893349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:28.895440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709dff5-58f4-4fb2-a383-8a68947fae66 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:28.897021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 66/140] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:28.902470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:29.008118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807047d-53a9-4fe8-bf2e-dfa87f2a40d7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:29.044419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:29.045093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.045377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.045650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.046418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:29.047877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dfdab-6a29-4bb5-98ba-c8dcf6bf6e7a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:29.175916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 75/141] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:28 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:29.205886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a0f4-4c7d-4bc0-99dd-b4bcb9e9c95a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.211183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a0f4-4c7d-4bc0-99dd-b4bcb9e9c95a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.211183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b724a0f4-4c7d-4bc0-99dd-b4bcb9e9c95a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.211183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 67/142] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:29.214382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.214676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.214959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.243406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:29.244695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:29.259442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:29.329436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:29.352458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a0f4-4c7d-4bc0-99dd-b4bcb9e9c95a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:29.409496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:29.460059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b724a0f4-4c7d-4bc0-99dd-b4bcb9e9c95a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:29.495286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:29.496095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.496381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.496653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.508328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-faeb398c-df26-407b-9a55-c769f0a57ff7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:29.516789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:29.517657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:29.519419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 68/144] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:29.524122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:29.627608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763e13-0379-42aa-9017-9ac87d9cd268 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:29.650154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd292f-9348-40a7-851f-22858cacee07 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.650460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd292f-9348-40a7-851f-22858cacee07 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.650709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd292f-9348-40a7-851f-22858cacee07 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.653957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 69/145] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:29.663778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.664070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.664675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.673212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:29.673914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.674208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.674490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.675253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:29.675566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:29.676989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:29.684973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:29.689426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:29.701798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 77/146] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:29.715667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:29.734602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:29.780709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 70/147] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:29.807168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:29.858279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:29.921554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a2281-e45d-4c21-8039-959fcb5feec7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:29.921961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ce3a1-f602-44a1-a69e-694427108d08 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:29.960332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:29.961139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:29.961426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:29.961700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:29.973828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:29.982180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:29.983064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:29.983884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 71/148] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:29.990313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.029313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.030240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.030525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.030859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] PATH_INFO: `/v3/users/56777341df2c4cab844262a96a2f81fe` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.032045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=56777341df2c4cab844262a96a2f81fe)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.033531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.039457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 78/149] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:29 2022] GET /identity/v3/users/56777341df2c4cab844262a96a2f81fe => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:30.046735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.103104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0706ce0-587f-4b83-a10f-08b85757c4d7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:30.106247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:30.141717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.142436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.142718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.142990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.143793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:30.144631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.146221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.166740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 72/150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:30.166740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.288515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:30.341169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b747e61-17eb-4f27-8c53-0e8a0807ea58 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:30.360277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847857f4-28a7-49f1-8c53-f03dedd89ee4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:30.399236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.400148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.400436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.400717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] PATH_INFO: `/v3/users/2caa6cb9210e46f2a79af594aec8b818` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.406605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] RBAC: Authorizing `identity:get_user(user_id=2caa6cb9210e46f2a79af594aec8b818)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.408088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.410222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 73/151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:30 2022] GET /identity/v3/users/2caa6cb9210e46f2a79af594aec8b818 => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:30.415597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.415845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.416476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.416764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.417044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.421883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.423373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.425289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 79/152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:30 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:30.434907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.458034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:30.551269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c48c8-872c-49ab-ae8e-466e326da4ca None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:30.572589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dd619-a0b5-4332-85e2-35871d222e5f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:30.613250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.614479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.614773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.615054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/56777341df2c4cab844262a96a2f81fe/roles/904a0ab8599949a18674c75cf7605e5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.615692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:30.616356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:30.616646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:30.616938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:30.617901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, user_id=56777341df2c4cab844262a96a2f81fe, role_id=904a0ab8599949a18674c75cf7605e5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.619583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.695507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:30.696990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:30.705499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:30 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/users/56777341df2c4cab844262a96a2f81fe/roles/904a0ab8599949a18674c75cf7605e5d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:27:30.737418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:30.827010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:30.832365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:30.846316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:31.001702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99e8f3-c2a7-434a-9fc6-bb8382ade148 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:31.044416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:31.045295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.045582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.045873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.047126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:31.048593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed816fb-e609-48bc-a385-aa08c30cfec1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:31.050347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 81/155] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:30 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:31.056527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:31.129735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d590d-91d8-4d0e-9f21-3a82a486cb59 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.130018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d590d-91d8-4d0e-9f21-3a82a486cb59 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.130276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d590d-91d8-4d0e-9f21-3a82a486cb59 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.131660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 82/156] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:31.137825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.138149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.138421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.164178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:31.165400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:31.211081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b1f5a8-9323-403c-80cb-26a4be179520 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:31.276422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:31.288767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:31.290572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.290868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.291150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.292025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=2caa6cb9210e46f2a79af594aec8b818) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:31.292340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:31.293835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:31.295738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 83/157] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:31.300875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 75/158] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:31 2022] GET /identity/v3/role_assignments?user.id=2caa6cb9210e46f2a79af594aec8b818&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:31.327560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:31.329765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:31.444017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ae73ad-c563-4151-aa53-f88c4352bdaa None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:31.482471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:31.483289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.483575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.483857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.495929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:31.503969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:31.505497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:31.506341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 84/159] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:31.511985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:31.642233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daada138-cbe3-4502-b8f1-1957f2a8821a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:31.685241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:31.686176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.686468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.686752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.687511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:31.687824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:31.689205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:31.698838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 76/160] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:31.704400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:31.779299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:31.811695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d2575-466e-4ed2-aef8-6687585b8e2b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:31.847508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:31.848500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:31.848791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:31.849073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:31.850388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:31.851860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2183db-481f-47f6-afcc-81415ea4dc94 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:31.853703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 85/161] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:31 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:31.859399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:31.925235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:31.979432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bcf0a-2d4c-46a5-9fff-3f76032abd38 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:32.026679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:32.027346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.027632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.027910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.110757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:32.112230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:32.157438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb248-edc7-4639-8a04-a19ee53d4c1f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.157768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb248-edc7-4639-8a04-a19ee53d4c1f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.158031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cb248-edc7-4639-8a04-a19ee53d4c1f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.159493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 86/162] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:32.165422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.165711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.166018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.186133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:32.187338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:32.207661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:32.269107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 77/163] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:32.273737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 87/164] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:32.281133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:32.323565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:32.429773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:32.444382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1673-68a8-4aa2-885f-7faac002530c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:32.476280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2a34-f3ea-4806-a839-3dd329c3666d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:32.510691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:32.511772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.512062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.512340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.513443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:32.513663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:32.514296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.514588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.514871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.515139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b00df21-a4c0-4025-874c-51e65cdd1182 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:32.517358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 78/165] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:32 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:32.522006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758579-03f7-4ef5-b6e2-1924fc235dde None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.522239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758579-03f7-4ef5-b6e2-1924fc235dde None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.522525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2758579-03f7-4ef5-b6e2-1924fc235dde None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.523801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 79/166] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:32.527259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758579-03f7-4ef5-b6e2-1924fc235dde None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:32.531816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-f838a630-f8cb-4024-8f96-9c665bef044a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:32.544888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:32.545749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:32.546752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 88/167] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:32.551765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.552053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.552335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:32.586936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:32.588093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:32.690274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2758579-03f7-4ef5-b6e2-1924fc235dde None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:32.750550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:32.751220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.751509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.751787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.752632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:32.752944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:32.754434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:32.760534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 80/168] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:32 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:32.761318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:32.783650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 89/169] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:32.846934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:32.876841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:32.886290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acd489-05fe-4384-bbb8-729acadad77c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:32.958324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:32.959031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:32.959318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:32.959597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:32.960534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:32.960918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:32.962419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:32.978334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:32.999029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 81/170] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:33.005044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.061185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd6ffd-0ef2-40da-a69f-ff67ead2f267 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.126308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.127718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.128152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.128600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.155792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:33.165256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:33.166437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:33.167374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:33.169608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 90/171] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:33.176103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.241904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3662fdb-d8b3-4d34-9602-f05f7bf3856a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.307220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.308101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.308384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.308662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.314644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:33.316079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:33.318530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 82/172] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:33.329348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.359659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3fca3-a388-4ce1-9a5f-8428edcfaf64 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.365940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:33.389514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:33.426784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.427741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.428196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.428619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.429514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:33.430005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:33.431607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:33.451072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 91/173] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:33.456513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.476733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f97f8-90ae-4ba5-9f04-08e208811135 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.512662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.513319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.513606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.513907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.584563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:33.586068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:33.607449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:33.689641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 83/174] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:27:33.691798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9c05b-fe0b-401d-854c-653bf951eac4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.698993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.767597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.768489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.768884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.769205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] PATH_INFO: `/v3/users/1714c86967334b0cba5e44e8951a3b7f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.770550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] RBAC: Authorizing `identity:get_user(user_id=1714c86967334b0cba5e44e8951a3b7f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:33.772006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:33.773670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 92/175] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/users/1714c86967334b0cba5e44e8951a3b7f => generated 275 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:33.779098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:33.866789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:33.890859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7ba34-c48b-436d-a958-e87e9a4f397d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:33.918339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:33.931124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:33.932363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:33.932880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:33.933369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:33.934841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:33.936530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:33.938530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 84/176] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:33.947224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.001040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259dad6-c747-4b48-84c1-adfc9b778658 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.043364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.044027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.044307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.044646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.109681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff7aba-ac9e-4a54-9743-085d18d53ca8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.125791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.127394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491ed3ff-5559-426e-adcf-5b7a9dd0d4c5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.145449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.146375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.146799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.147263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.148411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:34.148946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.150584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b46ca8-151d-46f9-82cd-c657cc13c423 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.162580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 85/177] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:34.163875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b54f-6f00-49aa-bde7-42c4729ae0e2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.166211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b54f-6f00-49aa-bde7-42c4729ae0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.166211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a7b54f-6f00-49aa-bde7-42c4729ae0e2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.166211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 86/178] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:34.166998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4bab1-ec2d-452c-b967-03e0dfe8ecd1 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.167279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4bab1-ec2d-452c-b967-03e0dfe8ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.167552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4bab1-ec2d-452c-b967-03e0dfe8ecd1 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.168844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 87/179] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:34.174065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92a0b-43a4-44c0-9e35-ac9c9021865e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.174356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92a0b-43a4-44c0-9e35-ac9c9021865e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.174637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb92a0b-43a4-44c0-9e35-ac9c9021865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.176400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.202670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5cb92a0b-43a4-44c0-9e35-ac9c9021865e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:34.203882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5cb92a0b-43a4-44c0-9e35-ac9c9021865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:34.298879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.314919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:34.316488 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0f492-c4f9-47ef-85ff-ef093d59a4f0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.317507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0f492-c4f9-47ef-85ff-ef093d59a4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.317613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0f492-c4f9-47ef-85ff-ef093d59a4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.326786 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 88/181] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:34.327975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d18eb-ac38-4c2b-8385-c337e9d7748e None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.328272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d18eb-ac38-4c2b-8385-c337e9d7748e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.328533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d18eb-ac38-4c2b-8385-c337e9d7748e None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.330524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 89/182] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:34.331237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d18eb-ac38-4c2b-8385-c337e9d7748e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.350889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-acd0f492-c4f9-47ef-85ff-ef093d59a4f0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:34.352418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-acd0f492-c4f9-47ef-85ff-ef093d59a4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:34.433445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 94/183] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:34.434680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38236c49-8125-4ca2-b3fa-f6c340b7de46 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.435553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38236c49-8125-4ca2-b3fa-f6c340b7de46 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.435553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38236c49-8125-4ca2-b3fa-f6c340b7de46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.451636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d18eb-ac38-4c2b-8385-c337e9d7748e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.453063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-38236c49-8125-4ca2-b3fa-f6c340b7de46 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:34.454306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-38236c49-8125-4ca2-b3fa-f6c340b7de46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:34.491202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.492065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.492353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.492626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] PATH_INFO: `/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.493832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7f5fec9330724ee7a9ffad6457bd6ba9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.495331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.497048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 90/184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/projects/7f5fec9330724ee7a9ffad6457bd6ba9 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:34.497809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.524189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 95/185] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42f47-1b41-42fd-98d4-442afd151ae7 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42f47-1b41-42fd-98d4-442afd151ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f42f47-1b41-42fd-98d4-442afd151ae7 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 96/186] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:34.528541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42f47-1b41-42fd-98d4-442afd151ae7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.550704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.600700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e316a-2f2f-4eb2-9192-9e8e925529e5 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.634238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.635037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.635325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.635600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.640634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f42f47-1b41-42fd-98d4-442afd151ae7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.646206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:34.654382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:34.655329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:34.656134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 91/187] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:34.656773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.680444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.681460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.681782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.682091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.693272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e3f81017-0d83-4c48-9bed-f2ac997390c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:34.700809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:34.701663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 97/188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:34.708031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.708838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.708838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.720412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:34.721583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:34.756442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e29852-c6eb-4e75-b777-f190ba13bb6d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.766842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.778729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:34.789459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.789695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 98/189] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:34.790529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.790952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.791233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.791510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.792364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=7f5fec9330724ee7a9ffad6457bd6ba9, user.id=1714c86967334b0cba5e44e8951a3b7f) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:34.792676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.794259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.800427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 92/190] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/role_assignments?user.id=1714c86967334b0cba5e44e8951a3b7f&scope.project.id=7f5fec9330724ee7a9ffad6457bd6ba9&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:34.801921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.913335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6943a-c755-49b6-a677-f596338926e0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.930276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568e4942-b1d8-4ab5-a360-1660cbd7f2a0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:34.951684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.952416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.952700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.952984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.954208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.955670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.957348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 99/191] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:34.958233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:34.975273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:34.976736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:34.977320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:34.977773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:34.978915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:34.979226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:34.980607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:34.990849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 93/192] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:34.991487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.029222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.040157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.073678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fda6e-17b3-4e5a-a035-ea1140cd1db6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.105299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a8de0-e6d1-43c7-abcd-621773913a85 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.106919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.107587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.107872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.108149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.108895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:35.109203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.110606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.119498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 100/193] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:35.120257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.144426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.145281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.145570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.145862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.155940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:35.164066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:35.164963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 94/194] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:35.166523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.219822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f2b27-1737-47d2-8e0f-f20b9c8607b6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.241265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.255271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.255930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.256243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.256491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.257293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.258748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.260001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.265696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15f0e9-278a-4894-817a-38bc666ba10d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.299267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.300129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.300411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.300684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.314304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.315808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.317481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 95/195] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:35.319240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.381402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 101/196] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:35 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:35.381402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.433796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2427c-4e19-404c-a303-5d1cd1c3a368 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.472855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.474302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.474589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.474866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.476138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.477610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.479346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 96/197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:35.480133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.494995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f7dad-5603-4b89-8cb4-8c7abda538c2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.508340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.537874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.538848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.539289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.539747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.540327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:35.540634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.542074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.552636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 102/198] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:35.553911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.602989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75364a59-1395-4590-945e-2bba3713a396 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.607521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.648322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.648987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.649282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.649561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.687318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf416a-b555-4904-8951-8debbe29f109 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:35.730874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.731741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:35.732407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:35.732512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.732688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:35.732961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:35.758206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.825246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:35.826770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:35.841879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 97/199] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:35.842941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.876588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:35.944291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 103/200] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:35.945430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:35.975368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7bdfb-d06e-49c6-97e9-15d59a26b88d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.008166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.022876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.024428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.025115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.025553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] PATH_INFO: `/v3/users/56777341df2c4cab844262a96a2f81fe` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.026916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] RBAC: Authorizing `identity:get_user(user_id=56777341df2c4cab844262a96a2f81fe)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.029147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.031369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 98/201] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/users/56777341df2c4cab844262a96a2f81fe => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.032432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.066127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f2c9-d8e0-47f5-9099-92562f51611a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.106116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.107074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.107433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.107786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.109168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.110896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.117871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 104/202] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:35 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.117871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.124978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.172055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3650a7-c555-4ac3-b928-2635807b212a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.217509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.218980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.219411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.220091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.221827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.224076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.226690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 99/203] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.228228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.231157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd704828-8235-4332-8967-b1b4c76b1833 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.274185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.275644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.275644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.275644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.303354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.347992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6668b-5810-4a91-a068-4c67e41adfc9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.351707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.353282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.361819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.384873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.385800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.386303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.386774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.387806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=e45dd4754d9f40678124746b2e2311c4) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:36.388327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.390284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.397002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 100/204] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/role_assignments?user.id=e45dd4754d9f40678124746b2e2311c4&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.398181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.469478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 105/205] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:36.478920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.510837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b618b-d43a-483e-9783-ced0cbfc2231 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.546330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.554046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.555092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.555567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.556127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.557353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=e45dd4754d9f40678124746b2e2311c4) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:36.559230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.561119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.575705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 101/206] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/role_assignments?user.id=e45dd4754d9f40678124746b2e2311c4&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.633433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be235-f343-4bd2-af37-0ec0ac5089f5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.642415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:36.673366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.674281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.674560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.675084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.676999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.678565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd11fb-d33c-4a6f-a447-140094438f63 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.680980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:36.686593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:36.839096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea74b4-148e-4584-be57-b3abf488fa40 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:36.875274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:36.875933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:36.876221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:36.876503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:36.877339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, scope.project.id=06d51b5b50744ab98dd32ada61d0a608, user.id=56777341df2c4cab844262a96a2f81fe) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:36.877658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:36.879151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aea691-cc20-4b76-95f9-773dff0ec873 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:36.885519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:36 2022] GET /identity/v3/role_assignments?user.id=56777341df2c4cab844262a96a2f81fe&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=904a0ab8599949a18674c75cf7605e5d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:37.737724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98303-e9bd-4745-b0e6-4cf3dccfe6e1 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:37.738292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98303-e9bd-4745-b0e6-4cf3dccfe6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:37.738292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d98303-e9bd-4745-b0e6-4cf3dccfe6e1 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:37.740494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:37.745647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:37.746084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:37.746270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:37.756752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6257-7d50-4fe8-a60d-044a11f3f41c None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:37.757045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6257-7d50-4fe8-a60d-044a11f3f41c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:37.757329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c6257-7d50-4fe8-a60d-044a11f3f41c None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:37.758731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 108/210] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:37.763736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:37.764201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:37.764495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:37.764934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:37.766163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:37.785461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:37.787376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:37.815479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:37.837452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:37.862743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:37.868688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:37.891787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:37.973684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb66a90-c970-4330-8c4c-80d3983024f3 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.009405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0308901-cd77-4920-b155-385dda32c2d6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.010756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.011714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.011946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.012292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.012728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.014088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.015701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.017613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 104/213] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:38.024017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.048026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.048833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.049120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.049391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.061539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:38.071408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:38.072457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:38.073438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:38.075762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 110/214] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:38.081507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.081977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.138414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674e204-57be-4f5b-9db5-33a523225423 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.183125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.184451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.185205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.186110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.187339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.188619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e23018-18b9-4f80-9654-6d0724f2563e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.189315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.225585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.226289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.226575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.226853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.227646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:38.228002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.229400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.239691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 111/215] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:38.245057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.274565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.306641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 105/216] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:38 2022] POST /identity/v3/users => generated 297 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:38.362943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756341d9-1e20-49f2-82db-61cb942a1f6e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.402556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.403453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.403741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.404019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] PATH_INFO: `/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.419877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] RBAC: Authorizing `identity:get_user(user_id=b5731bdb529b478d8bc2d9a48b98b9a9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.421364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f547435-f66d-4150-92c4-f27cb0ea8e37 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.423406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 112/217] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:38.429119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.543075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcbae-d9db-47a5-91f3-1f8488eb8f77 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.546839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.585447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.586162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.586450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.586728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.637774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a58a-12dc-4d42-a9ac-1c54a6509299 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.638157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a58a-12dc-4d42-a9ac-1c54a6509299 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.638451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3a58a-12dc-4d42-a9ac-1c54a6509299 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.640493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 113/218] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:38.646943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.647231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.647510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.667406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.668888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.679435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:38.681224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:38.772122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 114/219] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:38.796158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.803403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 106/220] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:38.813894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.814058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.814136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:38.903507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f16f1-6e99-44e9-b2da-429cb8939d47 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.915631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c568b-418e-4030-9927-eba00f0d8af0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:38.940295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.941376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.942207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.942492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.951267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:38.952125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.952409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.952686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.953933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:38.955396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:38.955572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:38.957120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 107/221] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:38.963509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a6fb4ec9-17e7-4634-80f6-37df080a81ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:38.965043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:38.965939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:38.966718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:38.967303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 115/222] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:38.975678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47177-9498-44b2-a338-48b38f80c8de None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:38.975969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47177-9498-44b2-a338-48b38f80c8de None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:38.976255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47177-9498-44b2-a338-48b38f80c8de None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:38.980501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 116/223] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:38.984924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47177-9498-44b2-a338-48b38f80c8de None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.050580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.072580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.085464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20699060-fe96-4ce7-b5bd-2cdce36e9346 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.100164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47177-9498-44b2-a338-48b38f80c8de None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.121471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.122371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.123104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.123389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.124519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=b5731bdb529b478d8bc2d9a48b98b9a9) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:39.124832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:39.126800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55a40c-f361-41a4-b131-c7e211c29a04 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:39.135007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 108/224] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/role_assignments?user.id=b5731bdb529b478d8bc2d9a48b98b9a9&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:39.136261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.136550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.136832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.138022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.138701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.139053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.139393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.140154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:39.140515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:39.142082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:39.153812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 117/225] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:39.159231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.174751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:39.176018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:39.310665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 109/226] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:39.333933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.407081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.436671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e5cd8-722b-4180-bfd1-a97af8b1f28a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.446187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79460b2-faf0-475d-adec-36510b9779f9 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.505547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.506456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.506745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.507027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.509595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:39.511082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:39.512738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 118/227] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:39 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:39.514415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.515223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.515510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.515789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.518827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.527354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.537306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:39.548817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:39.553913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:39.554694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 110/228] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:39.559037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.724405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f0960-78dd-47ec-b9c4-e6bb1e0dbb80 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.760407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c4a4d-ad4c-493a-907d-f625fead5fbd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:39.779212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.780088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.780371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.780648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.782516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:39.783977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:39.786273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 119/229] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:39 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:39.795553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.822207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.837310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:39.873540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:39.874004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 111/230] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:39.874004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:39.944914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:39.995891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8839e-40f7-4dc7-9c4b-03df06983182 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:40.036591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1b44a-8226-4c7a-af0a-7598b63f69d1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:40.067436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:40.068431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.068712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.068988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/e45dd4754d9f40678124746b2e2311c4/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.075202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, user_id=e45dd4754d9f40678124746b2e2311c4, role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:40.076648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:40.076937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:40.078201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.078944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.079461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.080858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:40.082561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:40.084426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 112/231] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:39 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:40.089958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:40.150793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:40.168050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 120/232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:39 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/e45dd4754d9f40678124746b2e2311c4/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:40.207529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94fa4-c867-4ecc-bffd-bbe978c477e5 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:40.256346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:40.257158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.257443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.257717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.260437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:40.262038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f36274-1a36-4bb6-8f43-c12bf84abe60 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:40.263989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 113/233] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:40 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:40.269766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:40.395004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb584147-d0a9-4451-8e9e-4eaf485677c3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:40.428034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:40.433616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:40.434631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.434920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.435198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/e45dd4754d9f40678124746b2e2311c4/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.437296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, user_id=e45dd4754d9f40678124746b2e2311c4, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:40.446581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3605de-cd77-4827-a2ec-2b32df7fb626 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:40.568578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:40 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/e45dd4754d9f40678124746b2e2311c4/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:40.878629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070431-4368-4947-81ff-dec344ec3a9a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.879760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070431-4368-4947-81ff-dec344ec3a9a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.879760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e070431-4368-4947-81ff-dec344ec3a9a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.881240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:40.886632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.887440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.887927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.893260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370be9-6666-4fb3-a22a-7d5790c618aa None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.893788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370be9-6666-4fb3-a22a-7d5790c618aa None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.894281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc370be9-6666-4fb3-a22a-7d5790c618aa None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.896718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 115/236] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:40.906397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:40.906945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:40.907430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:40.911739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:40.912981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:40.929632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:40.931228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:41.016116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 116/237] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:41.029606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 122/238] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:41.066136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.068394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.170326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:41.233159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e5b60-0387-4f52-9544-d4fde72090f7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.264809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21083001-78bd-4468-be99-11dba42a17d0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.266184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:41.299476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:41.300605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.301627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.302113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.311518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:41.312605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.312891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.313165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.315039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:41.316513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:41.324169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 117/239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:41.325021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.326319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:41.334194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:41.335070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:41.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:41.348690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 123/240] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:41.349616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.491287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7636c-eea5-4afe-9050-09418c568c05 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.524170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd2d06-032e-496c-bd12-c41c996592df None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.536594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:41.537660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.537660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.537962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.538722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:41.539033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:41.540436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:41.554156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:41.557724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 124/241] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:41.562945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.576952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:41.577887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.578319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.578795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.579819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:41.581476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4352ad54-160a-45a3-864a-4e972bf848f9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:41.634702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:41.659548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 118/242] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:41 2022] POST /identity/v3/users => generated 293 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:27:41.661407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dbb1c-77b4-4c04-9b2e-356366a5c941 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.662001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dbb1c-77b4-4c04-9b2e-356366a5c941 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.662509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dbb1c-77b4-4c04-9b2e-356366a5c941 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.664134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 119/243] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:41.670128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.671365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.671851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.695209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:41.697507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:41.726351 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c80b6-214a-487d-9d1e-2013a5ed5ade None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.798480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:41.799609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:41.800033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:41.800444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] PATH_INFO: `/v3/users/796e3fdff0a343d0aad737c99ee89bb7` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:41.808014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 120/244] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:41.834666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] RBAC: Authorizing `identity:get_user(user_id=796e3fdff0a343d0aad737c99ee89bb7)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:41.837198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.840632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:41.842459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 125/245] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/users/796e3fdff0a343d0aad737c99ee89bb7 => generated 297 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:41.850621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:41.966789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a53c6-943c-48ee-9bc2-c16cb8383411 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.979855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:41.992317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f208-02a7-48c4-9e8a-620378e27f56 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:41.996137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:42.012412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.013579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.014173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.014686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.028106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:42.038077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.039035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.039526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.039981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:42.040528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:42.041600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:42.049118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 121/246] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:42.051048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.128267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.130291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.176422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21890c03-4ad2-474c-84ba-e7e8507b771b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.222313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.223593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.224127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.224626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.225695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:42.226221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.228484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.240123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 122/247] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:42.246643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.252099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 126/248] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:42.258510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.262076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:42.285060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:42.372695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfedf3f-092b-4909-9a39-e924b359ce6f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.384214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fe016-080c-46bb-8e7c-a48d8e108e9e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.412835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.413286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.413574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.413879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] PATH_INFO: `/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.416055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] RBAC: Authorizing `identity:get_user(user_id=b5731bdb529b478d8bc2d9a48b98b9a9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.417879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.421631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 123/249] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:42 2022] GET /identity/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:42.429172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.433591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.434769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.435253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.435724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.437253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.438982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.443085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 127/250] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:42 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:42.448192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.530363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:42.555315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a128b16a-727c-4392-9adf-ee7d54cb1078 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.557422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:42.565115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b88bdc-2f5f-4891-a15f-4e1b522a01b1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.596208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.597473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.598617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.599209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.600660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.602564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.604946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 124/251] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:42 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:42.610772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:42.610950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.611516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.611804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.612084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.612929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=796e3fdff0a343d0aad737c99ee89bb7) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:42.613245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.615883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c5b8-bf81-4e5d-a4dc-7329cefdee24 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.623984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 128/252] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:42 2022] GET /identity/v3/role_assignments?user.id=796e3fdff0a343d0aad737c99ee89bb7&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=904a0ab8599949a18674c75cf7605e5d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:42.733176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e102e55-f8a7-4452-8d24-9f6e77244247 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:42.783131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:42.784318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.784745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.785162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/b5731bdb529b478d8bc2d9a48b98b9a9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.788095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, user_id=b5731bdb529b478d8bc2d9a48b98b9a9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:42.789787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241650d-6ab4-4c77-9f56-b2d2e1a583fd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:42.886101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 125/253] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:42 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/b5731bdb529b478d8bc2d9a48b98b9a9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:27:42.928182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999dd5-43cd-4b60-850d-4ca9cdb4ec65 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.928638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999dd5-43cd-4b60-850d-4ca9cdb4ec65 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.929022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0999dd5-43cd-4b60-850d-4ca9cdb4ec65 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.930837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 129/254] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:42.936817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf49f-94d0-4151-a6db-d30d48ce02ed None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:42.937260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf49f-94d0-4151-a6db-d30d48ce02ed None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:42.937641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bf49f-94d0-4151-a6db-d30d48ce02ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:42.956063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-940bf49f-94d0-4151-a6db-d30d48ce02ed None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:42.958014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-940bf49f-94d0-4151-a6db-d30d48ce02ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:42.982177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:43.046571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 126/255] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:43.070715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0999dd5-43cd-4b60-850d-4ca9cdb4ec65 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.183402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0999dd5-43cd-4b60-850d-4ca9cdb4ec65 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.203509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d8454-3700-49bf-bd26-cb14b0051fd3 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.203810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d8454-3700-49bf-bd26-cb14b0051fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.204079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d8454-3700-49bf-bd26-cb14b0051fd3 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.205475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 127/256] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:43.211695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.211989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.212308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.226886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.227728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.228016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.228295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.230647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:43.241710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:43.247781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:43.252309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:43.252419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:43.253261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:43.254203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 130/257] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:43.259757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.371673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6adbec-3d8e-4268-bd02-4534cbb09573 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.376164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 128/258] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:43.408334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.409013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.409304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.409586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.410463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:43.410776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:43.412246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:43.421431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 131/259] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:43.427140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.442593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.566250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:43.601537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e2f582-d320-4faf-a460-2c604ed9ac6b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.641221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:43.642275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.643095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.643550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.643841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.656026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:43.669678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:43.670592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:43.671370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 132/260] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:43.675922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f530ed-35f6-4642-87ff-0c09da2d246d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.676759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.718058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.719310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.719650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.719936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.721679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:43.723384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:43.725267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 129/261] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:43.730556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.850975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b594a-feb2-4d8f-ae8e-0d591189573b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.896439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e298cc6-a7ff-4f7d-955a-879fe39e23e9 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:43.907142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.908149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.908650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.909120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.914877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:43.936508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:43.937256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:43.937551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:43.937831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:43.939121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:43.939460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:43.941087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:43.953370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 133/262] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:43.959876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:43.983800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.076820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcef06-0300-42f9-9283-1c75da60afe6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.116001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.117331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.117775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.118339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] PATH_INFO: `/v3/users/e45dd4754d9f40678124746b2e2311c4` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.119970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] RBAC: Authorizing `identity:get_user(user_id=e45dd4754d9f40678124746b2e2311c4)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.122185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.124170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 134/263] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/users/e45dd4754d9f40678124746b2e2311c4 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:44.130380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:44.166683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.168285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.190217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.242394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda9485-0bc5-441b-b5a5-3900adf1127f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.281963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.282960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.283431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.283885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.341575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 130/264] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:27:44.359217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:44.361677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.363452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.426922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.442476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.472518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961ac89-a48c-4e4e-b27d-461b9103582b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.508577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.509365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.509648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.509951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.511163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.512638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.517871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 131/265] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:44 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:44.521589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 135/266] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:27:44.527200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:44.528267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:44.634960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a69f6-86a6-4f69-a724-4e4c5497789f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.689384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.691569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4783d7-d8e9-47ab-aa6c-574169caa11c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.692429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.692910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.694693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.695719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=e45dd4754d9f40678124746b2e2311c4) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:44.696210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.698041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.709946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 136/267] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:44 2022] GET /identity/v3/role_assignments?user.id=e45dd4754d9f40678124746b2e2311c4&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:44.732714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.746738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.747904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.748355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.749931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.750296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.751927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4818d2-854e-4b04-855e-fba91b4740b5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.754210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 132/268] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:44 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:44.760362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:44.778194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:44.890179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d403-ec3e-4f38-8ec2-83e02adf5b68 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:44.928287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:44.929269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:44.929736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:44.930373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:44.931433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=e45dd4754d9f40678124746b2e2311c4) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:44.931931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:44.933561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45256206-f2cd-4519-adaf-0557fc349dcc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:44.940980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 137/269] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:44 2022] GET /identity/v3/role_assignments?user.id=e45dd4754d9f40678124746b2e2311c4&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:45.013094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b41bb-a242-4e19-929f-83c730766156 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.014004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b41bb-a242-4e19-929f-83c730766156 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.014464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b41bb-a242-4e19-929f-83c730766156 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.016337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 133/270] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:45.031737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.032349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.032808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.056811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:45.058373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:45.136245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 138/271] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:45.162129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b41bb-a242-4e19-929f-83c730766156 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:45.281026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b41bb-a242-4e19-929f-83c730766156 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:45.323300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:45.324389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.324854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.325332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.326735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:45.328460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f07f-3d49-4be3-b6a9-0395df9825bd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:45.330806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 134/272] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:45.335860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:45.339401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:45.349044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1c302-8529-4a37-a0ce-f54c1f2d9845 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.349603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1c302-8529-4a37-a0ce-f54c1f2d9845 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.350081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1c302-8529-4a37-a0ce-f54c1f2d9845 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.351475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 135/273] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:45.356556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.356849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.357127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.382072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:45.383262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:45.463314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:45.480703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 136/274] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:45.484401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4fd46-9c20-44c1-ba98-4b5615beb88e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:45.508066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:45.524723 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:45.526096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.526607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.527127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.528673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:45.530609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:45.630860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cde89-378d-426a-9775-a6bdf75d4d94 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:45.638332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 139/275] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:27:45 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:45.676712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:45.677590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.677926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.678214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.692167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:45.700479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:45.701453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:45.702272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 137/276] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:45.711322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:45.781891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:45.826086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db5195-ad33-41a1-a95e-8a008a4de791 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:45.862427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:45.863111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:45.863453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:45.864265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:45.865513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:45.866169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:45.867780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:45.877475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 140/277] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:45.883517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:45.953270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.013140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa9218-2631-4a3f-8bd7-e862701ab5d5 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.049541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.050604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.050893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.051675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] PATH_INFO: `/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.066315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] RBAC: Authorizing `identity:get_user(user_id=aaad93f55d7c4e83b2f861cfd12f5f1e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:46.068394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc218a6-c715-421d-af6e-1542700a6257 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:46.070466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 138/278] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:45 2022] GET /identity/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:46.075858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.084044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167ab4-7527-46e0-b158-2ca5eab0bd22 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.084596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167ab4-7527-46e0-b158-2ca5eab0bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.085053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd167ab4-7527-46e0-b158-2ca5eab0bd22 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.086656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 139/279] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:27:46.094712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e896e6-13bf-49d4-8d3f-8dc8e41da0e3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.095257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e896e6-13bf-49d4-8d3f-8dc8e41da0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.095712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e896e6-13bf-49d4-8d3f-8dc8e41da0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.117259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c2e896e6-13bf-49d4-8d3f-8dc8e41da0e3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:46.118504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c2e896e6-13bf-49d4-8d3f-8dc8e41da0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:46.188193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e27d7-35b4-4af3-b682-cbed6c86c9d9 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.224273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 140/280] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:46.230154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798950cd-c97c-498d-95b0-85eccc6d61c5 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.230154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798950cd-c97c-498d-95b0-85eccc6d61c5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.230154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798950cd-c97c-498d-95b0-85eccc6d61c5 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.230154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 141/281] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:46.232427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.246972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.247464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.247887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.253370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.255781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.259955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.260323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.261991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, user.id=aaad93f55d7c4e83b2f861cfd12f5f1e, scope.system=all) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:46.262388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:46.264321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:46.267373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:46.268583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:46.270505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 141/282] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/role_assignments?user.id=aaad93f55d7c4e83b2f861cfd12f5f1e&scope.system=all&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:46.272682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.302366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.348862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 142/283] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:46.374586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.405736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4dbe7-d340-422f-95ed-cb01511e1531 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.457694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.459557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.459843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.460119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.485431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:46.494419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:46.495377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:46.496574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 142/284] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:46.501734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.547790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88bb41-039a-4959-8221-fda25c1cb0d5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.556705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.629636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.630472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.630751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.631021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.637100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd68be-7ef3-481f-8976-9d1713ab7049 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.655008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:46.668734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:46.669795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:46.670694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:46.672803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 143/285] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:46.677196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.708544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.709144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.709427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.709701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.710489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:46.710799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:46.712203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:46.720286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.721315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 143/286] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:46.726778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.799536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45d-6e87-41d8-a38f-86f93d344af3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.829439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d8155-76fa-4a17-a816-5b9c8f6de41d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:46.836347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.837288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.837580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.837878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.838654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:46.838967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:46.840355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:46.850218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.862815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 144/287] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:46.864219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.874596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:46.875504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:46.875791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:46.876068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] PATH_INFO: `/v3/users/796e3fdff0a343d0aad737c99ee89bb7` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:46.878835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] RBAC: Authorizing `identity:get_user(user_id=796e3fdff0a343d0aad737c99ee89bb7)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:46.881079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:46.882780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 144/288] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/users/796e3fdff0a343d0aad737c99ee89bb7 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:46.888201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:46.961892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:46.975505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb612d28-101f-4fa4-ac6d-291f99f7ab0c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.011565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.012441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.012773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.013054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] PATH_INFO: `/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.014603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=b5731bdb529b478d8bc2d9a48b98b9a9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.016045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.022142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 145/289] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/users/b5731bdb529b478d8bc2d9a48b98b9a9 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:47.023932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:47.084290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed6e43-e47e-4683-8774-62e97fc28c3b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.130023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62330ecd-da44-4bf5-98bb-f2c0a3849ba0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.168862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.169521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.169807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.170128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.196157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.197526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:47.197782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.198414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.198414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.202693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.204270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.206288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 145/290] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:46 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:47.220243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:47.246828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.248497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.338204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:47.354165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 146/291] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:27:47.359919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:47.418733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:47.467931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cfbd65-c50d-4171-b525-21ebeb426a54 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.492034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c7600-e4cd-4dd0-afae-9e1398c2e2af None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.505339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.506522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.506952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.507376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.508793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.510436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.512284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 147/292] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:47 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:47.517980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:47.574635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.575460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.575747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.576025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/796e3fdff0a343d0aad737c99ee89bb7/roles/904a0ab8599949a18674c75cf7605e5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.582666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, user_id=796e3fdff0a343d0aad737c99ee89bb7, role_id=904a0ab8599949a18674c75cf7605e5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.584124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e672192-61a5-421e-aeb7-0a304a06ffa2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.625937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f332fa9-fd9e-480b-879a-1bc27a65982c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:47.655872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:47.667520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:47.668178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:47.668464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:47.668739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:47.669719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=b5731bdb529b478d8bc2d9a48b98b9a9) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:47.670062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:47.671611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d1893-b819-43fc-a101-117f4e90f382 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:47.678351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 148/293] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:47 2022] GET /identity/v3/role_assignments?user.id=b5731bdb529b478d8bc2d9a48b98b9a9&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:47.681649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 146/294] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:27:47 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/users/796e3fdff0a343d0aad737c99ee89bb7/roles/904a0ab8599949a18674c75cf7605e5d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:27:48.143422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d98c-75a9-4818-a346-19b76f24dd46 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.143924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d98c-75a9-4818-a346-19b76f24dd46 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.143998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965d98c-75a9-4818-a346-19b76f24dd46 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.145660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 149/295] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:48.151128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15bc7c-3a05-4e1a-8bd9-6d94c1fec1ba None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.151423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15bc7c-3a05-4e1a-8bd9-6d94c1fec1ba None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.151709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15bc7c-3a05-4e1a-8bd9-6d94c1fec1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.174175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-cd15bc7c-3a05-4e1a-8bd9-6d94c1fec1ba None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:48.175372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cd15bc7c-3a05-4e1a-8bd9-6d94c1fec1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:48.265593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 147/296] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:48.288711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965d98c-75a9-4818-a346-19b76f24dd46 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.401466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965d98c-75a9-4818-a346-19b76f24dd46 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:48.437874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:48.438725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.439010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.439285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.440459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:48.442534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:48.444542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 150/297] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:48.446604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31cfa-763b-4172-bd24-2baa05694cb4 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.447064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31cfa-763b-4172-bd24-2baa05694cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.447347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff31cfa-763b-4172-bd24-2baa05694cb4 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.448809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 148/298] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:48.449955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.453351 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.453633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.453934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.471006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:48.472255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:48.513061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:48.521868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:48.549284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:48.561193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852ff9d-da09-416b-8045-1ffa5fdd7f84 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:48.568879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.597422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:48.598926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.599347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.599795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] PATH_INFO: `/v3/groups` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.600637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:48.602227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd2f15-0a67-4e72-8c54-c2b0488c0ee3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:48.671592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 151/300] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 03:27:48 2022] POST /identity/v3/groups => generated 229 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:48.673303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ecd8-9b26-4133-a31d-11b50edcdc70 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.673600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ecd8-9b26-4133-a31d-11b50edcdc70 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.673898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6ecd8-9b26-4133-a31d-11b50edcdc70 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.675411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b9196-becb-453f-a308-7dc15c6402b6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:48.675560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 152/301] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:48.681488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.681980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.682266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.700982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:48.702289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:48.725067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:48.726707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.726996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.727269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.744919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:48.755771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:48.756697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:48.757487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:48.761938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 150/302] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:48.763852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.789460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 153/303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:48.798786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:48.813806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.863633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:48.890762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa337e6c-29e5-43fa-ae4d-571c1b83f19c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:48.931447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774647-59a4-4398-a1b0-282b4595e2e0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:48.937360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:48.938268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.938725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.939160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.940071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:48.940558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:48.942637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:48.958449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 151/304] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:48.963631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:48.984258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:48.985114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:48.985397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:48.985674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:48.998007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:49.007264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:49.008108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:49.008892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:49.011614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 154/305] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:49.018857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:49.080399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:49.104412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b1979-b2ac-4ca1-9b11-b6d5fc9e0b16 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:49.131537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7abea-b272-4c04-a070-0262bf3d1a18 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:49.139094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:49.140736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:49.141616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:49.141921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:49.142198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] PATH_INFO: `/v3/users/20f5aaf8b3b74476886683b057146444` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:49.158234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] RBAC: Authorizing `identity:get_user(user_id=20f5aaf8b3b74476886683b057146444)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:49.160132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:49.162883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 152/306] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:48 2022] GET /identity/v3/users/20f5aaf8b3b74476886683b057146444 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:49.168345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:49.175434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:49.177239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:49.177678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:49.178147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:49.179054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:49.185339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:49.185339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:49.190427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 155/307] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:49.197517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:49.300433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38e92f-4967-4855-ab80-be805f13697c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:49.308084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f033d60-7174-4080-b8aa-6ca4ca7fca5b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:49.343533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:49.344797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:49.344903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:49.345423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:49.345525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:49.345812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:49.346117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:49.346468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] PATH_INFO: `/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:49.346941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, user.id=20f5aaf8b3b74476886683b057146444, scope.system=all) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:49.347248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:49.348795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] RBAC: Authorizing `identity:get_user(user_id=aaad93f55d7c4e83b2f861cfd12f5f1e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:49.349334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2709e4-1686-464e-9481-3c7ab6c6b4dd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:49.350655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:49.357518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 156/308] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:49 2022] GET /identity/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:49.358167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 153/309] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 03:27:49 2022] GET /identity/v3/role_assignments?user.id=20f5aaf8b3b74476886683b057146444&scope.system=all&role.id=904a0ab8599949a18674c75cf7605e5d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:49.358951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:49.408483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:49.482245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073acfd-dad9-4aad-9f93-fdc1b75a3c4f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:49.521187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:49.522085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:49.522362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:49.522640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] PATH_INFO: `/v3/system/users/aaad93f55d7c4e83b2f861cfd12f5f1e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:49.524114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aaad93f55d7c4e83b2f861cfd12f5f1e, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:49.525493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2235d-2705-4d42-8715-1bd59aef15b6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:49.625053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 157/310] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 03:27:49 2022] PUT /identity/v3/system/users/aaad93f55d7c4e83b2f861cfd12f5f1e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:50.051150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0350e-ba42-4b5c-b9cb-7a67ae4d0945 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.051472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0350e-ba42-4b5c-b9cb-7a67ae4d0945 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.051715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0350e-ba42-4b5c-b9cb-7a67ae4d0945 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.053374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 154/311] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:50.058728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.059025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.059311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.076418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:50.077944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:50.149392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 158/312] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:50.172887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0350e-ba42-4b5c-b9cb-7a67ae4d0945 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:50.188327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:50.391623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0350e-ba42-4b5c-b9cb-7a67ae4d0945 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:50.429162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:50.430330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.430831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.431301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.442432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:50.450748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:50.451609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:50.452380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:50.454721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 155/313] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:50.462965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:50.495676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:50.569352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b0956-f995-467b-b770-eb2ba9db6b20 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:50.611730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:50.612411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.612696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.612975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.613776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:50.614135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:50.615778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:50.624905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 159/314] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:50.630914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:50.701214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:50.741382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c8a0f-89d7-48c3-aba4-cf52e5755410 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:50.777507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:50.778637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.779062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.779503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] PATH_INFO: `/v3/users/796e3fdff0a343d0aad737c99ee89bb7` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.780849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] RBAC: Authorizing `identity:get_user(user_id=796e3fdff0a343d0aad737c99ee89bb7)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:50.782495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9734e7b8-0082-41b4-947a-f755a6ca907b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:50.784589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 156/315] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:50 2022] GET /identity/v3/users/796e3fdff0a343d0aad737c99ee89bb7 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:50.790543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:50.888699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:50.889281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f0a8-c883-462c-9b29-7ef4919bb59b None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.889786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f0a8-c883-462c-9b29-7ef4919bb59b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.890285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614f0a8-c883-462c-9b29-7ef4919bb59b None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.892074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 157/316] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:50.898119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.907779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.907892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c151c-f8e5-4258-8ad9-ddd960fd8c1a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:50.907970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:50.916921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:50.918448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:50.934967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:50.935628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:50.935916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:50.936197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.008741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 158/317] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:51.025610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.027373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.031247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.099675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.132666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.137636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7afd7-2bfd-428d-9c63-e96b1e52c2fe None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.145274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 160/318] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:51.150955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.179785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.180586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.180874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.181153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.182383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.183964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.189934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 159/319] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:51.192054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.284584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb7bb9-1f12-4550-8b5d-6c105a030738 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.308585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39110bfb-cfd9-4d5b-9b6f-71b30eced5dd None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.321922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.322935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.323217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.323491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.324834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.326809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.329898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 161/320] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:51.334767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.356546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.358119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.358870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.359339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] PATH_INFO: `/v3/groups` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.360542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.362840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d72a9-7c57-41b1-b77d-a007c698ecae None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.368083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.399766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.435513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 160/321] 10.222.0.42 () {60 vars in 1134 bytes} [Fri Jun 24 03:27:51 2022] POST /identity/v3/groups => generated 226 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:27:51.438724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2132-4df7-4cc4-9338-89e40be23fe0 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.439256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2132-4df7-4cc4-9338-89e40be23fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.439927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c2132-4df7-4cc4-9338-89e40be23fe0 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.442950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 161/322] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:51.444088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd13319-0dac-43c1-9177-3e7be73142bd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.451707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369530f-2c57-421d-9fac-d8aa9155c176 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.452390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369530f-2c57-421d-9fac-d8aa9155c176 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.452869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369530f-2c57-421d-9fac-d8aa9155c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.471782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6369530f-2c57-421d-9fac-d8aa9155c176 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:51.473929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6369530f-2c57-421d-9fac-d8aa9155c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:51.496557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.497298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.497509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.498517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.499499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047, user.id=796e3fdff0a343d0aad737c99ee89bb7) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:51.499814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.501601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.510488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 162/323] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/role_assignments?user.id=796e3fdff0a343d0aad737c99ee89bb7&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=904a0ab8599949a18674c75cf7605e5d => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:51.560161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 162/324] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:51.585170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.689769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e9a5-41c7-4d00-8157-5b32e85ddf46 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.690472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e9a5-41c7-4d00-8157-5b32e85ddf46 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.690927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e9a5-41c7-4d00-8157-5b32e85ddf46 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.693275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 163/325] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:51.701675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.702081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.702426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.710782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba3594-9309-4c30-889d-1f56a0d960f0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.724260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:51.725449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:51.745800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.757572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.758465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.758818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.759411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.771476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:51.781358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:51.782395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:51.783212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 163/326] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:51.791475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.834505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 164/327] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:51.857217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.915324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce6156-5a7f-4b09-b917-01e0fda719db None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:51.924420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:51.960469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:51.961143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:51.961426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:51.961704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:51.962485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:51.962797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:51.964176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:51.975862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 164/328] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:51.979614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:51.982841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fa198-7890-4d5b-83a6-b090051c6c86 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.042668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.043521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.043778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.044053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.048503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:52.057388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:52.065279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:52.066228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:52.067584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 165/329] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:27:52.075511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:52.152552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d79ed4-25ac-47ac-b771-66931e3a0316 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.202896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.203684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c671a2-2a71-4991-8d00-1ba88e935e78 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.203794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.204077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.204352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] PATH_INFO: `/v3/users/20f5aaf8b3b74476886683b057146444` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.205570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] RBAC: Authorizing `identity:get_user(user_id=20f5aaf8b3b74476886683b057146444)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:52.207640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:52.212547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 165/330] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:51 2022] GET /identity/v3/users/20f5aaf8b3b74476886683b057146444 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:52.218070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:52.222765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:52.257881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.258502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.261136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.261497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.262399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:52.262780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:52.264304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:52.273841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 166/331] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:52.279320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:52.335205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3c6f-cc2a-4b39-a033-b5c5218ac886 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.350906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:52.382573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.383826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.384314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.384820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] PATH_INFO: `/v3/system/users/20f5aaf8b3b74476886683b057146444/roles/904a0ab8599949a18674c75cf7605e5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.386694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20f5aaf8b3b74476886683b057146444, role_id=904a0ab8599949a18674c75cf7605e5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:52.388306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817817e5-4afe-49da-b161-87ddd76ae82e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:52.407977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54adfb3-8fad-44f1-b83d-a98d8a1aa44d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.444990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.445941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.446229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.446507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] PATH_INFO: `/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.447730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] RBAC: Authorizing `identity:get_user(user_id=aaad93f55d7c4e83b2f861cfd12f5f1e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:52.449314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:52.451352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 167/332] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:52 2022] GET /identity/v3/users/aaad93f55d7c4e83b2f861cfd12f5f1e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:52.457204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:52.460893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 166/333] 10.222.0.42 () {58 vars in 1334 bytes} [Fri Jun 24 03:27:52 2022] PUT /identity/v3/system/users/20f5aaf8b3b74476886683b057146444/roles/904a0ab8599949a18674c75cf7605e5d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:27:52.521835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:52.574974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63f0b5-eec4-4d30-90de-14a497376680 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:52.612980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:52.613751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:52.614070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:52.614350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:52.615504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] RBAC: Adding query filter params (role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, user.id=aaad93f55d7c4e83b2f861cfd12f5f1e, scope.system=all) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:52.615819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:52.617267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534d993-6c0f-4ddd-9e2a-7632fee37468 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:52.630714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 168/334] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 03:27:52 2022] GET /identity/v3/role_assignments?user.id=aaad93f55d7c4e83b2f861cfd12f5f1e&scope.system=all&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:27:54.537313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63d04-ea05-4ca5-a0e5-7fa74ebd8357 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.538337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63d04-ea05-4ca5-a0e5-7fa74ebd8357 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.538833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f63d04-ea05-4ca5-a0e5-7fa74ebd8357 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.540473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 167/335] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:54.546311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3905-f6be-49c6-be06-d24079d6d323 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.547209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3905-f6be-49c6-be06-d24079d6d323 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.547688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d3905-f6be-49c6-be06-d24079d6d323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.565734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8e9d3905-f6be-49c6-be06-d24079d6d323 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:54.568048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8e9d3905-f6be-49c6-be06-d24079d6d323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:54.650772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 169/336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:54.656799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dffe5-7c6f-42b2-beb8-cf5c71859e4a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.657336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dffe5-7c6f-42b2-beb8-cf5c71859e4a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.657811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dffe5-7c6f-42b2-beb8-cf5c71859e4a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.659396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 168/337] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:54.666278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b36c8-5ac0-4232-861f-b7aed986559d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.666806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b36c8-5ac0-4232-861f-b7aed986559d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.667275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b36c8-5ac0-4232-861f-b7aed986559d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.690991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8d3b36c8-5ac0-4232-861f-b7aed986559d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:54.693052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8d3b36c8-5ac0-4232-861f-b7aed986559d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:54.705723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dffe5-7c6f-42b2-beb8-cf5c71859e4a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:54.730315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:54.785384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 170/338] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:54.786584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726444-4b46-47cb-ab3c-1e334d88c6ae None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.786878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726444-4b46-47cb-ab3c-1e334d88c6ae None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.787159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7726444-4b46-47cb-ab3c-1e334d88c6ae None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.792363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 171/339] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:54.795366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.795659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.795940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:54.817790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:54.822503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:54.916421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dffe5-7c6f-42b2-beb8-cf5c71859e4a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:54.953133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 172/340] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:27:54.954005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:54.987975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:54.988846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:54.989130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:54.989402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.001196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:55.009264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:55.012043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:55.012973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:55.015328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 169/341] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:55.016270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.068824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.095048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.104707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a9d10-fb38-4b0b-a6a4-8d5de40ec666 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.137874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85fe17d-0b78-428c-8f76-ca7d9f8142f6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.167510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.168463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.168845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.169363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.179029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.179837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.180118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.183977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.193684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:55.206208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:55.211575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:55.212490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:55.213267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:55.215741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 173/342] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:55.216539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:55.227367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:55.228283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:55.229087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 170/343] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:55.236680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.381998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.382377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb1bad-f02f-4c8e-80aa-7d193de79cda None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.387727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5205b-3b7d-4a22-bd14-ae5b5a51890d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.426500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.427576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.428061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.428519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.429467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] RBAC: Adding query filter params (name=member) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:55.429988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:55.431549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0cb550-03d3-42e8-9fa9-0ebe643c5aac None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:55.431817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.432654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.433080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.433485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.434446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:55.434757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:55.436443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:55.445708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 171/344] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:55.446462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 174/345] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:55.447171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.451839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3213-9721-4e1e-a6b6-9ae7c92ce7c5 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.451839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3213-9721-4e1e-a6b6-9ae7c92ce7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.451839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3213-9721-4e1e-a6b6-9ae7c92ce7c5 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.451839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 175/346] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:55.454868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3213-9721-4e1e-a6b6-9ae7c92ce7c5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.474237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.564612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9600656-c257-4c4c-9432-83551d60cc41 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.578927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3213-9721-4e1e-a6b6-9ae7c92ce7c5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.606244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.607293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.607714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.608126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.609114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:55.609672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:55.611203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:55.619710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.620389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.620676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.620955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.622386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 172/347] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:55.623440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.650368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.696992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:55.698517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ef736-a1dc-4eef-9205-64eb1106745b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:55.715561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.735968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1daedb-3f58-4d58-969e-a184f2ef927b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:55.776215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:55.777664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.778226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.778720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.809883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 176/348] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:55.811240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:55.811470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:55.811748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:55.830383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:55.831589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:55.856039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:55.858070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:55.892496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.906598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 177/349] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:55.908407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:55.965662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:55.984649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 173/350] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:55.985957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.046392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf23f3-1621-498a-9264-c782a70d3f30 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.089307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.090002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.090287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.090560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.127819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dba23-fb7b-4bd3-a2be-cb5a62220aeb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.154679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.171652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.172067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.172919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.173111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.173212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.173456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.174675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.176195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9029c-86da-4350-bbe8-b9e598bd6642 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.182873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 174/351] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.183882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0438-aec1-4823-9b32-336bb355dc8b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.184874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0438-aec1-4823-9b32-336bb355dc8b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.185164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b0438-aec1-4823-9b32-336bb355dc8b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.189998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 175/352] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:56.191222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0438-aec1-4823-9b32-336bb355dc8b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.228281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.300183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 178/353] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:56.302015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.313022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b0438-aec1-4823-9b32-336bb355dc8b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.358415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.359229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.360400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.360400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.372069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-309e4341-3896-4dde-88b1-65f45b53b73d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:56.380671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:56.381567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:27:56.382451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:56.383066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 176/354] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:56.384021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e42f-dba5-415b-9676-cc5d4323cf80 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.384308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e42f-dba5-415b-9676-cc5d4323cf80 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.384587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0e42f-dba5-415b-9676-cc5d4323cf80 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.388112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 177/355] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:56.388112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e42f-dba5-415b-9676-cc5d4323cf80 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.424395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a620b4-2b62-4aa3-9c0d-0ed8363e8a38 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.446486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.468159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.469163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.469453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.469751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.471129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.472597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918563b-8ca6-49c4-8f14-768cba16d4e7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.474391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 179/356] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.475691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf077-fa9b-4eaf-bcde-7f51fc9768a0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.475982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf077-fa9b-4eaf-bcde-7f51fc9768a0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.476265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7bf077-fa9b-4eaf-bcde-7f51fc9768a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.495610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1b7bf077-fa9b-4eaf-bcde-7f51fc9768a0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:56.496809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1b7bf077-fa9b-4eaf-bcde-7f51fc9768a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:56.505468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.507506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0e42f-dba5-415b-9676-cc5d4323cf80 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.547592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.548453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.548762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.549013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.555766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.557237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.558953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 178/357] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.559731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.579135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 180/358] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:56.580477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.581490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.581765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.600104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:56.602579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:56.680600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 181/359] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:56.681946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.689334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e974ce0-1cb3-4635-b900-e25e17d213ab None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.711814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.732935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.739040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 179/360] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.739652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.764611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.796924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6f469-37cf-4be6-84e2-20760ceb3ca3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.839470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.840158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.840447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.840727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.841485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:56.841792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.843379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.853331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 182/361] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.854200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.862418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5887ed2-c871-48cb-81db-25ead102f59c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:56.904064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:56.906178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:56.906467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:56.906743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:56.908595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:56.910858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:56.912222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 180/362] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:56.912525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:56.980186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:56.982672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dd40f-9387-45a6-a05d-85f067b1040a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.031441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.032213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.032497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.032770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.033595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:57.034781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.036359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.039361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.042745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 183/363] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.042868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a717fd9-c85c-4bce-81a6-0eb96d7c7d7d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.046759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.090387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.091202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.091483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.091753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.105298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:57.113210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:57.114255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 03:27:57.115321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:27:57.119870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 181/364] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:57.120826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.184869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defbc3c2-0825-494c-9ff9-238d289e8efd None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.226584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.227313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.228036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.228036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.239709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:57.243159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f5054-9f79-4bf7-8794-081361d4a0d2 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:57.247566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:57.248454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:57.249225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 184/365] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:57.249893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.260793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.288252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.289344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.289782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.290125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.291379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.293838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.296893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 182/366] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.298922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.334552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.385065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29383b1-5db5-4212-b2c9-a9ffaaa09ea2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.428611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.429265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.429547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.429821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.434794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8826e-564c-4c2b-876e-e7e81db1d078 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.477312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.478029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.478276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.478545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.479365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=06d51b5b50744ab98dd32ada61d0a608) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:57.479674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.481099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.498044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 183/367] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.498044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.519570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.521468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.574900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.604028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.621121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562d14f-0147-4060-83b8-1ebbdbf04f0a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.651513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 185/368] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:57.652575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.665608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.666314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.666897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.667183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.668209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:57.668523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.671321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.682271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 184/369] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.683124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.772157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b1157-f01b-4918-af3a-bd8c556f5f92 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.798430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f1187-b2be-4600-a2c6-82dc6e838d85 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.801789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.809417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.814510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.823255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 186/370] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.824582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.843278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.844064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.844357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.844680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.845630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=06d51b5b50744ab98dd32ada61d0a608) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:57.845946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.847426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.849280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:57.862142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 185/371] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.863461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:57.931964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e71d46-50d9-4827-8c7a-e8bb6d270fd1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:57.968562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:57.969601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:57.969997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:57.970375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:57.971768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:57.973422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:57.980627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 187/372] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:57.981645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.017551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf7cea-d580-4c81-9771-acea9b32f4b1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.060527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.061875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.062299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.062700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] PATH_INFO: `/v3/users/20f5aaf8b3b74476886683b057146444` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.064164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] RBAC: Authorizing `identity:get_user(user_id=20f5aaf8b3b74476886683b057146444)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.065801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.068440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 186/373] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/users/20f5aaf8b3b74476886683b057146444 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.069504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.088938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.101399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88e7e4-d07c-46d5-8694-3a21d30b3d14 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.110988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.138043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.138855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.139252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.139842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.187968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e95e8-86f1-4be5-8a90-b46ca4ba9091 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.209918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.211670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.227498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.228607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.229017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.229428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.231025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.232647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.234914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 187/374] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.235879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.305272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.321500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 188/375] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:27:58.321500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.353161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56404066-d8ce-4b90-a242-9c1f5a829ff4 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.363242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.423829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6eb189-05e2-4ee6-8f21-7d3893aa635b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.425175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.426187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.426715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.427126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.428089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] RBAC: Adding query filter params (role.id=904a0ab8599949a18674c75cf7605e5d, user.id=20f5aaf8b3b74476886683b057146444, scope.system=all) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:58.428546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.430160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.448735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 188/376] 10.222.0.42 () {56 vars in 1308 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/role_assignments?user.id=20f5aaf8b3b74476886683b057146444&scope.system=all&role.id=904a0ab8599949a18674c75cf7605e5d => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.458638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.461549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.462563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.462815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.463188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.464787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:58.464787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.466166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.472983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 189/377] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.576604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b12491-21fd-40c4-ba7e-a041e120656e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.616530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.617659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.618144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.618560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] PATH_INFO: `/v3/projects/dc8d9d26aed04d1b8b0e31128b902112` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.619922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] RBAC: Authorizing `identity:get_project(project_id=dc8d9d26aed04d1b8b0e31128b902112)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.621517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.623821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 189/378] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/projects/dc8d9d26aed04d1b8b0e31128b902112 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.630225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.713612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.776690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58bc267-2925-40d8-a8ca-8e3c9a501945 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:58.820982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:58.821879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:58.822150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:58.822425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] PATH_INFO: `/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:58.834549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] RBAC: Authorizing `identity:get_group(group_id=f88543d34d0a4f5c9ee5f1e70ae3e7b3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:58.835940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45385ae3-2035-460b-a4d7-02cc013d0255 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:58.838014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 190/379] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:58.843414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:58.893403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:58.983520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b150b7c-40cb-4010-8e88-52a3aa16a69b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:59.039145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:59.039813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:59.040095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:59.040372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:59.041203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] RBAC: Adding query filter params (group.id=f88543d34d0a4f5c9ee5f1e70ae3e7b3, role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=dc8d9d26aed04d1b8b0e31128b902112) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:59.041517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:59.042987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6688b4a0-199f-4104-a9a3-981eb2a39237 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:27:59.054392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 190/380] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:27:58 2022] GET /identity/v3/role_assignments?group.id=f88543d34d0a4f5c9ee5f1e70ae3e7b3&scope.project.id=dc8d9d26aed04d1b8b0e31128b902112&role.id=20658940146144b9b9afa747f31d7a5d => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:27:59.479330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee8b06-68a3-40d2-bf3b-225ade094def None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:59.479680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee8b06-68a3-40d2-bf3b-225ade094def None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:59.479924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee8b06-68a3-40d2-bf3b-225ade094def None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:59.481587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 191/381] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:27:59.486629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:59.486921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:59.487196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:59.514891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:27:59.516096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:27:59.595565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 191/382] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:27:59.626309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee8b06-68a3-40d2-bf3b-225ade094def None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:59.747086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee8b06-68a3-40d2-bf3b-225ade094def None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:59.767616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:59.786210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:59.793914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:59.793914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:59.793914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:59.810730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:27:59.818578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:27:59.819523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:27:59.820335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:27:59.823340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 192/383] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:27:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:27:59.828907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:27:59.861331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:27:59.952713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6b7a9-9566-4c12-91b3-54e04fb3d9f2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:27:59.996270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:27:59.996943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:27:59.997278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:27:59.997495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:27:59.998663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:27:59.998663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:27:59.999919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c2835-0aa6-4056-a3e7-54dfe9c61b67 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.013803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 192/384] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:27:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:00.018976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.136426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a6d0-6dbd-4031-92e8-44e8d671feb9 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.136787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a6d0-6dbd-4031-92e8-44e8d671feb9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.136997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85a6d0-6dbd-4031-92e8-44e8d671feb9 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.138396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 193/385] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:00.141288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6896-3ff7-45e7-98dd-74c75a23da68 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.149176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.149777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.150304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.170288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:00.171801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:00.214632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.215506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.215792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.216070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.217287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:00.218759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.220741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 193/386] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:00.225875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.254810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 194/387] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:00.272629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.291964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:00.316481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:00.376996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e4daf-5bce-4ce1-a67b-90ebbe33b0d0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.412127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.413283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.413771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.414275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.424680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:00.433158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:00.434058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:00.434852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:00.437517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 195/388] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:00.445242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.459052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9fba-abf6-4af5-be75-a42b7fad4d88 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.524755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.526061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.529262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.529755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.531198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:00.532847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.536265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 194/389] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:00.541814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.603899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:00.648116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e07d3c0-e73d-4dac-9ca4-fb3e977393b9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.694662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.695336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.695622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.695948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.696642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:00.696952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:00.698476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca78dc2-826b-4d91-a4a7-b227a45ab7d8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.706099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0444e128-20ae-41b8-b71f-52b2a31ec222 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.708158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 196/390] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:00.713022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88437-32a2-4461-81f1-dafae5fd97eb None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.713022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88437-32a2-4461-81f1-dafae5fd97eb None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.713022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca88437-32a2-4461-81f1-dafae5fd97eb None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.713022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 197/391] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:00.718141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca88437-32a2-4461-81f1-dafae5fd97eb None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.728094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:00.751888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.753507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.754607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.755089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.757548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, group_id=5d48c688ddc14da29bcb954ef9d0f177, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:00.759434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d67d5b-4a86-4a75-863a-4a0b7a3b0f5d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.828041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca88437-32a2-4461-81f1-dafae5fd97eb None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:00.843065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 195/392] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 03:28:00 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:28:00.850170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.850170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.850170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.878123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:00.879903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:00.903319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:00.904187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:00.904472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:00.904751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:00.907261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:00.908739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:00.911866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 198/393] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:00.917793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:00.932440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.042386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 196/394] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:01.060463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.114592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568517-0232-4f9a-a1fe-bc2d1b38bbe3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.165254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.166818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.167310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.168029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.170169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:01.172429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485930d-bcf2-4ca5-8a95-274e5850f68f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:01.174389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 199/395] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:00 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:01.182004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce4f0-db58-4d3c-bd75-1be1c8d2fbe8 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.182004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce4f0-db58-4d3c-bd75-1be1c8d2fbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.182004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce4f0-db58-4d3c-bd75-1be1c8d2fbe8 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.182004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 200/396] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:01.184724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ce4f0-db58-4d3c-bd75-1be1c8d2fbe8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.200129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4cd6b-0b7a-4832-9616-101649e53351 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.202737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.252500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.253319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.253604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.253977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.272455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:01.278840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-2e76e44b-aec5-48fc-a14d-069b7b3197f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:01.280861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:01.281721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:01.282531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:01.285985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 197/397] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:01.287265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.287556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.288065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.307037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:01.308233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:01.317638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ce4f0-db58-4d3c-bd75-1be1c8d2fbe8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.362875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.365217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.365940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.366409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.368950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, group_id=5d48c688ddc14da29bcb954ef9d0f177, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:01.371247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:01.384495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 198/398] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:01.390046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.455915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 201/399] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 03:28:01 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:28:01.455915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.539575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.557523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fd1c0-384a-47b4-9740-b08bedc50414 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.625413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.626107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.626391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.626666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.627478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:01.627791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:01.630036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:01.646174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 199/400] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:01.655620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.677433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc35ce2c-d5d6-41a2-9b3d-22988f9c199c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.717906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.719160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.719635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.720100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.722745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.734261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:01.745285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:01.746253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:01.747051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:01.749663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 202/401] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:01.757639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.768362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b05283-c246-414f-843a-fdd73ea8d7a5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.822587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.823463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.823755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.824031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.825494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:01.826938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e3cce-066d-4af4-afd9-3bb617773a76 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:01.828862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 200/402] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:01.835264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3a12e-9a50-4795-8c8c-d8e718808529 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.835552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3a12e-9a50-4795-8c8c-d8e718808529 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.835834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3a12e-9a50-4795-8c8c-d8e718808529 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.838359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 201/403] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:01.842681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d79-f960-422e-a237-4201437768b6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.842994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d79-f960-422e-a237-4201437768b6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.843274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d79-f960-422e-a237-4201437768b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.860351 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9c202d79-f960-422e-a237-4201437768b6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:01.861523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9c202d79-f960-422e-a237-4201437768b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:01.876012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40241696-fd4e-4a1d-b1cb-fbda38bb0213 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:01.880250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:01.914469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:01.915845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:01.916320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:01.916814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:01.917750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:01.918296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:01.919850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:01.928586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 203/404] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:01.933899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:01.945949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 202/405] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:01.946876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202d79-f960-422e-a237-4201437768b6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.009561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:02.054922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9271557-ff33-44a8-9406-6f70ce55af1a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.078266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202d79-f960-422e-a237-4201437768b6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.090937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.091800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.092084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.092358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.093759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.095490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.098918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 204/406] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:02.102242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.124823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.126152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.126666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.127131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.128652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.130905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.133057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 203/407] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:01 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:02.134099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.166459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:02.229819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123629a-9088-4635-8763-8782cb516c9a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.240400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b573-56a3-4340-90ed-4b139f5bf77c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.262811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:02.276950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.280752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.280752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.280752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.280988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.280988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.280988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.280988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.283240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d51b5b50744ab98dd32ada61d0a608, group_id=5d48c688ddc14da29bcb954ef9d0f177, role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.285038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.292150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:02.299946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:02.307439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 205/408] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:02.308224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.376071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 204/409] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 03:28:02 2022] PUT /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:02.376071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.451303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769eb37b-c2b2-4998-b092-83481855b287 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.522597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02596160-2874-45ac-999e-5684f28788aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.523553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02596160-2874-45ac-999e-5684f28788aa None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.523835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02596160-2874-45ac-999e-5684f28788aa None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.524106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02596160-2874-45ac-999e-5684f28788aa None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.529663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02596160-2874-45ac-999e-5684f28788aa None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.531173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02596160-2874-45ac-999e-5684f28788aa None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.540311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 206/410] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:02 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:02.543773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02596160-2874-45ac-999e-5684f28788aa None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.549061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:02.596980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7678069-bd4c-408b-937a-2e0253125841 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.626984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:02.641356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.642392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.642895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.643172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.643927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:02.644233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.646223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.665797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 205/411] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:02.671998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.717548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02596160-2874-45ac-999e-5684f28788aa None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.784653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.788610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.789116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.789594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.793090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] RBAC: Authorizing `identity:create_grant(project_id=6b3950b5233047a1a6a5ba5923fbe047, group_id=5d48c688ddc14da29bcb954ef9d0f177, role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.795043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.835462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf603-2431-4dc5-84ce-e1ba2c4d3a86 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:02.872955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:02.874207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:02.874692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:02.875195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] PATH_INFO: `/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:02.876607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] RBAC: Authorizing `identity:get_group(group_id=f88543d34d0a4f5c9ee5f1e70ae3e7b3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:02.878371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:02.881378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 206/412] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:02 2022] GET /identity/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3 => generated 229 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:02.888368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 207/413] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 03:28:02 2022] PUT /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047/groups/5d48c688ddc14da29bcb954ef9d0f177/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:28:02.889448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:02.914022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:03.028860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4750062-6145-43f3-a9fe-6145cfa1a29b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:03.071607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:03.072651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.073055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.073424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] PATH_INFO: `/v3/projects/dc8d9d26aed04d1b8b0e31128b902112` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.074754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] RBAC: Authorizing `identity:get_project(project_id=dc8d9d26aed04d1b8b0e31128b902112)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:03.076304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f7b261-7d5d-4b5c-bda7-12cfd4ca1b64 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:03.078137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 207/414] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:02 2022] GET /identity/v3/projects/dc8d9d26aed04d1b8b0e31128b902112 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:03.084691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:03.151576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e95b-6805-4d50-afbe-d9d54ad4c0e6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.152069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e95b-6805-4d50-afbe-d9d54ad4c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.152450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456e95b-6805-4d50-afbe-d9d54ad4c0e6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.154341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 208/415] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:03.163534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.163829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.164108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.181741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:03.183234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:03.205454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18acf52b-1c63-4d1e-b1d4-0a65b3e6e18a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:03.221824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:03.261704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:03.262841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.264414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.264840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] PATH_INFO: `/v3/projects/dc8d9d26aed04d1b8b0e31128b902112/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.271192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc8d9d26aed04d1b8b0e31128b902112, group_id=f88543d34d0a4f5c9ee5f1e70ae3e7b3, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:03.273419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:03.296039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 209/416] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:03.322440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:03.333663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:03.369709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 208/417] 10.222.0.42 () {58 vars in 1442 bytes} [Fri Jun 24 03:28:03 2022] PUT /identity/v3/projects/dc8d9d26aed04d1b8b0e31128b902112/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:03.442878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd9421-25cc-4876-80f9-eb112afec636 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:03.481689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:03.482790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.483222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.483645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.496268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:03.505072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:03.506229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:03.507210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:03.509202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 210/418] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:03.515148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:03.652260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e26813-e1a4-421e-bb3f-74772077b897 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:03.691266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:03.692691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.693124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.693546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.694502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:03.695012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:03.696622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc3f7-497a-4a92-8a33-12bd91538df4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:03.705872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 209/419] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:28:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:03.712160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:03.784460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:03.823511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2ae88-8c8b-4e9e-bc49-38229006d1f4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:03.845610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bb04-f05e-460c-b836-d9e2bb838c4b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.846148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bb04-f05e-460c-b836-d9e2bb838c4b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.846606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47bb04-f05e-460c-b836-d9e2bb838c4b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.848665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 210/420] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:03.853803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.854291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.854714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.875624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:03.877135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:03.877300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:03.877885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:03.878175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:03.878449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:03.911143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:03.977310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:04.001083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.009397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.011010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:04.103365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:04.156487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 211/422] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:04.165748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.175787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d4965-7256-41dc-b8c3-775b7a0aae51 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.272083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e90a1-3a7d-4ea6-a258-4f8e8f1ab86e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.279488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.280592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.281082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.281575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.309800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:04.317541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:04.318444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 03:28:04.319239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:04.320375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.321725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.321725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.321725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.323019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.324460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:04.326179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 212/423] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:04.327174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 212/424] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:04.331881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.334752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.387211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:04.392025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:04.464485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7e336-35f8-4cf8-8b74-3f14ef89a35e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.505128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.506010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.506287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.506560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.507850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.509277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:04.511223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 213/425] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:04.518788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.528325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0886fc19-5b53-4d32-b42b-9ed428a9dfbe None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.565784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.567407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.567939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.568419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.569372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] RBAC: Adding query filter params (name=member) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:04.569946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.572288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:04.582834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:04.592956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:04.660255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e84ea4d-dfb3-42f7-96a6-8ef6dc17b7fc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.662674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:04.704295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.708354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.708640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.708919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.709782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:04.710104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.711660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:04.727907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 214/427] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:04.749777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:04.773889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a3c73-98fd-4968-915a-3efe6037fc02 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:04.858892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:04.859922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:04.860442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:04.860987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:04.972395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:04.974854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3052005-b15e-4ad8-9885-05cec868da78 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:05.076346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.091968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 214/428] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:05.097359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.113897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48690c-b601-4b49-ae7d-b9a9350d7d3d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.114198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48690c-b601-4b49-ae7d-b9a9350d7d3d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.114480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48690c-b601-4b49-ae7d-b9a9350d7d3d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.116535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 215/429] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:05.123317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188add41-8860-4e64-9217-928760cb77d2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.123612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188add41-8860-4e64-9217-928760cb77d2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.123891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188add41-8860-4e64-9217-928760cb77d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.143577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-188add41-8860-4e64-9217-928760cb77d2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:05.146314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-188add41-8860-4e64-9217-928760cb77d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:05.230530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5d63f-5f98-49e1-a297-8618d0a1bafd None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.240887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 216/430] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:05.271312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188add41-8860-4e64-9217-928760cb77d2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.272214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.273472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.273972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.274472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.275935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:05.277627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:05.279885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 215/431] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:05.286198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.333075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.402121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188add41-8860-4e64-9217-928760cb77d2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.412349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ba3c2-df8f-4cc3-925d-b574ca9dc55c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.420203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.438369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.439178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.439464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.439737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.447740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.448600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.448882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.449158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.450206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:05.450423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:05.451786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdef4c-e546-47c3-8a6b-706112589495 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:05.453568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 216/432] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:05.454582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6ca4-e226-4f7e-855f-a35024949ab8 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.454868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6ca4-e226-4f7e-855f-a35024949ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.455140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc6ca4-e226-4f7e-855f-a35024949ab8 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.456493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 217/433] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:05.461361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6ca4-e226-4f7e-855f-a35024949ab8 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-8751be01-b53e-4bbd-b1c2-85c031cb7b4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:05.464176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:05.465055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 217/434] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:05.470874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.471577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.471577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.485294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:05.486430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:05.554408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 218/435] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:05.555080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.580153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc6ca4-e226-4f7e-855f-a35024949ab8 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.583251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.618884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.619541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.619821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.620146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.620947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=9c65cdf40d6b4cd7ae29835be0fb90b8, scope.project.id=06d51b5b50744ab98dd32ada61d0a608) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:05.621525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:05.622835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:05.637888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 218/436] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:05.637888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.695791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa0cb-8782-42c2-bb90-9b2bb0de13e5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.707696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.746247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.747049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.747586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.747865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.749276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:05.749708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:05.751880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:05.758143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399340c-d93a-4b43-86ec-146d959f70f6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.768743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 219/437] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:05.770292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.805067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.807349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.807349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.807349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.818237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:05.826883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:05.827775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:05.828552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 219/438] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:05.834257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:05.874751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:05.896444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2471e65-dbaf-4a67-9c87-5800c2be8892 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.936689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:05.937344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:05.937630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:05.937942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:05.962229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd7f9-f144-4d7e-a3f0-fb2b8eff1bc1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:05.977931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.010687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.012081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.012081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.012081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.012934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:06.013257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.014671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b85145-15cd-42c1-927f-08ea8efe800e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.021879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.023362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ea270-2354-4718-a28b-f2f436b83449 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.024405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 220/439] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:06.025664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b219f-a67e-4cd9-ab0b-a35bbdae9d5f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.026025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b219f-a67e-4cd9-ab0b-a35bbdae9d5f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.026309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b219f-a67e-4cd9-ab0b-a35bbdae9d5f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.027561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 221/440] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:06.030714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b219f-a67e-4cd9-ab0b-a35bbdae9d5f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.130021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 220/441] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:06.131167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.131452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.131729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.137660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.148040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b219f-a67e-4cd9-ab0b-a35bbdae9d5f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.148262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:06.149464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:06.181929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.182575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.182855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.183125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.211180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.216490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 221/442] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:06.217300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.253184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.255243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.316370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b423d-647f-4fa9-a495-263562dffc45 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.341197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.350831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 222/443] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:06.352532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.352532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.352532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.352810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] PATH_INFO: `/v3/projects/06d51b5b50744ab98dd32ada61d0a608` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.353289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.354160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] RBAC: Authorizing `identity:get_project(project_id=06d51b5b50744ab98dd32ada61d0a608)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.355728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.357430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 222/444] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/projects/06d51b5b50744ab98dd32ada61d0a608 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.358344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.422036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.454580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca237a-214d-4922-8f98-ccc7569cce0b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.456909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10cd4a-babb-40b1-a1ae-5d0ff20fcdbe None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.486953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.487742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.488029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.488839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.489893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.491000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.491281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.491562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] PATH_INFO: `/v3/projects/6b3950b5233047a1a6a5ba5923fbe047` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.492737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] RBAC: Authorizing `identity:get_project(project_id=6b3950b5233047a1a6a5ba5923fbe047)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.494191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.495858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 223/445] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/projects/6b3950b5233047a1a6a5ba5923fbe047 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.496603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.503396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:06.511546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:06.512400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:06.513188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 223/446] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:06.513823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.564521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.598226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0925b0-2b4e-4626-a477-37d9574ebed1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.615846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be55ae4-c562-4eb3-94b3-ab4077a58fc4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.632909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.633782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.634095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.634371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.635541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.636964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.638601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 224/447] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.639350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.641751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.648602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.649454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.649972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.650064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] PATH_INFO: `/v3/groups/5d48c688ddc14da29bcb954ef9d0f177` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.651390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] RBAC: Authorizing `identity:get_group(group_id=5d48c688ddc14da29bcb954ef9d0f177)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.652940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.654706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 224/448] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/groups/5d48c688ddc14da29bcb954ef9d0f177 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.655518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.744288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f47e2-fb97-402e-8abc-0d6cc5d2ec6b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.758014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90b8c-f974-4923-851c-ac0ac3790110 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.775460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.778051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.778707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.778988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.779263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.779997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:06.780305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.781748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.790366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 225/449] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.791141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.793016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.793829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.794292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.794597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.795435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=06d51b5b50744ab98dd32ada61d0a608) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:06.795746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.797173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.804724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 225/450] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=06d51b5b50744ab98dd32ada61d0a608&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.805425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:06.862844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:06.906064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc023928-c49c-42ee-ba0a-26d3494e0103 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.921339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7f95-7c05-4e0b-b341-49ba80b44cff None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:06.948983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.950353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.950652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.950932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:06.951770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] RBAC: Adding query filter params (group.id=5d48c688ddc14da29bcb954ef9d0f177, role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=6b3950b5233047a1a6a5ba5923fbe047) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:06.952086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:06.953525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:06.960961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 226/451] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/role_assignments?group.id=5d48c688ddc14da29bcb954ef9d0f177&scope.project.id=6b3950b5233047a1a6a5ba5923fbe047&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:06.961114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:06.961509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:06.961790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:06.962090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:07.031452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:07.056751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:07.058562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:07.168558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 226/452] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:07.174301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:07.280057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f1078f-9455-490f-a594-042222e02727 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:07.308082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:07.315567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:07.316504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:07.317014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:07.317099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] PATH_INFO: `/v3/projects/dc8d9d26aed04d1b8b0e31128b902112` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:07.318363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] RBAC: Authorizing `identity:get_project(project_id=dc8d9d26aed04d1b8b0e31128b902112)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:07.319928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:07.321624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 227/453] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:28:07 2022] GET /identity/v3/projects/dc8d9d26aed04d1b8b0e31128b902112 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:07.327380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:07.409291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:07.427120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d18338-4fdd-42b4-986e-ac087a4204aa None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:07.462180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:07.463044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:07.463331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:07.463609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] PATH_INFO: `/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:07.464769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] RBAC: Authorizing `identity:get_group(group_id=f88543d34d0a4f5c9ee5f1e70ae3e7b3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:07.466246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6448e7-1de1-4a66-9e8c-3c6d25ab5990 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:07.467876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 227/454] 10.222.0.42 () {56 vars in 1180 bytes} [Fri Jun 24 03:28:07 2022] GET /identity/v3/groups/f88543d34d0a4f5c9ee5f1e70ae3e7b3 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:07.474228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:07.571758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edec6d3-8607-4b1f-b68d-8017a455dfd9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:07.603639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:07.604275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:07.604557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:07.604835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:07.605659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] RBAC: Adding query filter params (group.id=f88543d34d0a4f5c9ee5f1e70ae3e7b3, role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=dc8d9d26aed04d1b8b0e31128b902112) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:07.606003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:07.607418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56616b-5fea-4227-9bcc-91683a32cd29 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:07.613062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 228/455] 10.222.0.42 () {56 vars in 1376 bytes} [Fri Jun 24 03:28:07 2022] GET /identity/v3/role_assignments?group.id=f88543d34d0a4f5c9ee5f1e70ae3e7b3&scope.project.id=dc8d9d26aed04d1b8b0e31128b902112&role.id=20658940146144b9b9afa747f31d7a5d => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:10.264467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5c29-696c-4910-b355-4d802563c422 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.265440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5c29-696c-4910-b355-4d802563c422 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.265949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da5c29-696c-4910-b355-4d802563c422 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.267766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 228/456] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:10.274238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd00b-0220-4ed5-83ab-24e5ac0a2237 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.274773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd00b-0220-4ed5-83ab-24e5ac0a2237 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.274773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bd00b-0220-4ed5-83ab-24e5ac0a2237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.275026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fdc2-9073-4814-acf5-24c6dbf55573 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.275549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fdc2-9073-4814-acf5-24c6dbf55573 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.276044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037fdc2-9073-4814-acf5-24c6dbf55573 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.277818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 229/457] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:10.283240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.283794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.284279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.297063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-789bd00b-0220-4ed5-83ab-24e5ac0a2237 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:10.305118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-789bd00b-0220-4ed5-83ab-24e5ac0a2237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:10.317606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:10.318828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:10.392965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:10.413726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 229/458] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:10.413726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ccc-b981-4db9-bb10-cbf14e6cd716 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.413726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ccc-b981-4db9-bb10-cbf14e6cd716 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.413726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d3ccc-b981-4db9-bb10-cbf14e6cd716 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.413726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 230/459] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:10.423741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.424116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.424970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.443596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 230/460] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:10.444521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.449421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:10.450829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:10.540327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:10.551806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 231/461] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:10.557898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.563672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9e9d-b960-4812-a7a6-1d6ebc722117 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:10.607786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:10.608942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.609293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.610079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.623936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:10.626211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:10.651443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:10.652331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:10.653329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:10.653329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:10.653329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.653329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:10.653329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 231/462] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:10.658208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.693929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f79f69-fccf-4f31-8135-5e01a532de4f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:10.720197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:10.735686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:10.736863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.737314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.737830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.749317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:10.751590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:10.771863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:10.772733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:10.773545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:10.773545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:10.773545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.773545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:10.780521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 232/463] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:10.781741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.784479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf8f1c-1aa7-45fa-8d4d-3bc03a8540be None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:10.824036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:10.829457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:10.830290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.830574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.830852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.845477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:10.847293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:10.872132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:10.873044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 232/464] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:10.879210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.905823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a068e-3c73-4ab8-a49f-997724ee2a61 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:10.942426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:10.943089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:10.943378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:10.943663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:10.944382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:10.944693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:10.946114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:10.963230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 233/465] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:10.963230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:10.996692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731db42e-c35b-479d-9d37-a1b44389d766 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.000500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.033753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.034851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.035934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.036438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.037331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:11.037787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.039437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8facf32-5f85-4a2e-8fce-7322c7ebd49d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.051867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 233/466] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:11.053309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fe73-8893-4bfe-b9c4-6eae6e336d7c None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.053793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fe73-8893-4bfe-b9c4-6eae6e336d7c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.054222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23fe73-8893-4bfe-b9c4-6eae6e336d7c None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.055869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 234/467] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:11.056842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fe73-8893-4bfe-b9c4-6eae6e336d7c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.075931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741444a9-5ae3-46d8-9bed-a4602cec1f06 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.106377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.112710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.113581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.113872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.114142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.115103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:11.115209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.119372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08985266-3810-49b3-8aed-f85886ef3ee5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.132877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 234/468] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:11.134580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.134871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.135150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.151840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:11.153022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:11.166228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23fe73-8893-4bfe-b9c4-6eae6e336d7c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.200645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.201318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.201605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.201913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.202628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.204062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.224507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 235/469] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:11.228249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.258172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.325882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 235/470] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:11.325882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.346004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd166740-363d-4274-bdb3-89cf998fc90a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.386455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.387132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.387416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.387696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.388414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.389904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.432698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.435889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd0da-f2ca-4602-95ae-8cf0381bd760 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.470846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.471850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 236/471] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/users => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:11.471960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.471960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.472111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.472267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.473361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.475333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf958fc-ef75-4547-b361-608a3f3f46bb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.562690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 236/472] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:11.564051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4fce-a38c-4828-afbf-ea67c0593720 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.564342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4fce-a38c-4828-afbf-ea67c0593720 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.564651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf4fce-a38c-4828-afbf-ea67c0593720 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.566404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 237/473] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:11.572760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4878a-585d-4412-97ab-3833140c756f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.573050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4878a-585d-4412-97ab-3833140c756f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.573326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4878a-585d-4412-97ab-3833140c756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.594663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.597759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-00c4878a-585d-4412-97ab-3833140c756f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:11.599599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-00c4878a-585d-4412-97ab-3833140c756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:11.622599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5345b4-57b0-4e05-988a-49f120688862 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.669889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.670915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.671265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.671648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.684302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.686743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.699837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 238/474] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:11.706780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:11.707865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:11.708873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:11.708873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:11.708873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:11.708873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.714235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 237/475] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:11.716055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4878a-585d-4412-97ab-3833140c756f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.729536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.822800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.841010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c4878a-585d-4412-97ab-3833140c756f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.856589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d596bb1-bc11-4256-a16c-92db43fb035d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:11.890688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.891860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.892696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:11.893183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.893987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.895282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:11.895736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.897378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.901198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:11.901198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:11.901198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:11.901198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:11.901779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:11.903176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:11.914945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 239/476] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:11.920255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:11.944980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.sql.core [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 03:28:11.944980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 03:28:11.944980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [parameters: {'id': '0041ff9afff94c058b2e59f6e559af84', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 03:28:11.944980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80791) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result.read() Jun 24 03:28:11.967741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:28:11.968777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application yield resource Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise self.value Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application session.commit() Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 03:28:11.969831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.session.flush() Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application compat.raise_( Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 03:28:11.970722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:28:11.971578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result.read() Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:28:11.978385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [parameters: {'id': '0041ff9afff94c058b2e59f6e559af84', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:11.980067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 03:28:11.981724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:11.983496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 238/477] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/roles => generated 144 bytes in 243 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:11.991310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:12.102856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50caaf2-3bb0-4138-8f05-9e52c44fd967 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:12.147909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f68e-d915-4e91-97ff-d2285d4edca1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:12.162560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:12.163587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:12.164030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:12.164439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:12.183561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:12.196997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:12.198134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 03:28:12.199114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:12.204655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 239/478] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:12.211798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:12.230584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:12.231484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:12.231903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:12.232339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:12.233251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:12.234913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc14e-2943-4db5-a2f6-d4c92f1f3b47 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:12.330740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:12.373749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 240/479] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:11 2022] POST /identity/v3/users => generated 249 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:12.383469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7cfa85-0a4b-4c8f-90b2-d5b79d6b791b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:12.424525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:12.424525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:12.424525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:12.424525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:12.425798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:12.426266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:12.427868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba09bb6-9be9-44c7-8771-aa52c1eb3636 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:12.442026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 240/480] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:13.737087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d70eb-99f0-43a0-bc79-29fe62f24d99 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:13.737642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d70eb-99f0-43a0-bc79-29fe62f24d99 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:13.737642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d70eb-99f0-43a0-bc79-29fe62f24d99 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:13.739883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 241/481] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:13.745080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:13.745479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:13.745642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:13.767408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:13.768619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:13.857840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 241/482] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:13.885560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d70eb-99f0-43a0-bc79-29fe62f24d99 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:13.888474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.028902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d70eb-99f0-43a0-bc79-29fe62f24d99 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.081623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.082963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.083246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.083523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.101933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-0ad2d229-8e5d-474f-9f47-b61f563a6249 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:14.109623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:14.110503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.111265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:14.113972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 242/483] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:14.116828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.127381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4231dd0-8fec-4ddc-b19d-446189bb4af3 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.127663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4231dd0-8fec-4ddc-b19d-446189bb4af3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.127944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4231dd0-8fec-4ddc-b19d-446189bb4af3 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.130104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 243/484] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:14.134885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.135175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.135454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.158429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:14.159672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:14.203013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.222180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.234790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 244/485] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 03:28:14.262854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.308270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900f53-457b-4e0d-a9df-be140d9d42b1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.351271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.352085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.352369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.353403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.354183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:14.354492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:14.355856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58961945-05a4-49a6-8082-acaa344728f7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:14.366751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 242/486] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:14.372580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9fda-a55c-46ff-ba77-64169832d43b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.373017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9fda-a55c-46ff-ba77-64169832d43b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.373303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc9fda-a55c-46ff-ba77-64169832d43b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.375159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 243/487] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:14.375859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc9fda-a55c-46ff-ba77-64169832d43b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.393285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a56d35-b3f8-425b-9d23-7bf3a9494c0b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.436001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.436793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.437075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.437346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.449236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-5070f1ee-5bdc-4b95-a9ba-f3228c16a2d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:14.457057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:14.457942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:14.458708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 245/488] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:14.460308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.465875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.465875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.478795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:14.480087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:14.516032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc9fda-a55c-46ff-ba77-64169832d43b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.530783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.533709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.551748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 246/489] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:14.552733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.571342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.572244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.572567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.573094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.588704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:14.590729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:14.627422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:14.629734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 244/490] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:14.631269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.674615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7cd5c-3c48-446a-a5cc-e5480c734966 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.719847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.720530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.720818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.721525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.722318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:14.722664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:14.724753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:14.737943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:14.739315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.750901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55ab45-90f9-4d51-84f4-64bafc0ab7eb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.786839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.787548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.787829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.788101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.799159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:14.800131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:14.808105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:14.815313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:14.817306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.839580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:14.868615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60806f46-9f16-4d9e-93a5-75e5a49e3fea None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.902784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.903438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.903725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.904003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.904720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:14.905022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:14.906419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:14.918733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:14.919336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:14.933643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f4462-f713-4a21-bdd7-a76cc84133f7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:14.971696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:14.972889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:14.973369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:14.973646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:14.987214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:14.988758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-81990636-6a32-48b6-be8a-9f9c451f36e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:15.008158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.008960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.009813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:15.009813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:15.009813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.009813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:15.014145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.015373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ddd58-9e98-4fbe-9cfd-1bccd89f7cc2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.015666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ddd58-9e98-4fbe-9cfd-1bccd89f7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.015949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ddd58-9e98-4fbe-9cfd-1bccd89f7cc2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.022166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 247/495] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:15.022166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ddd58-9e98-4fbe-9cfd-1bccd89f7cc2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.038098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cfbdd-6d60-4d24-a729-7fc1a95fc188 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.040920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.073839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.074548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.074836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.075112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.075853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:15.076160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.077524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.091708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 249/496] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:15.092607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.097615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.129622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ddd58-9e98-4fbe-9cfd-1bccd89f7cc2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.167001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.168070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.168355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.168633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.176222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.177684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-76db104c-023f-439b-be2a-99c0951c0706 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:15.193444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.194556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:15.195667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 248/497] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.196405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b0f-4cf2-4753-bb5b-80ed5374f48e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.196405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b0f-4cf2-4753-bb5b-80ed5374f48e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.196656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d2b0f-4cf2-4753-bb5b-80ed5374f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.203516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ca3dc-5faa-48f6-a042-d80a87101da9 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.213264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4a5d2b0f-4cf2-4753-bb5b-80ed5374f48e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:15.214492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4a5d2b0f-4cf2-4753-bb5b-80ed5374f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:15.239023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.239685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.239976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.240256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.241240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:15.241546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.242934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.254985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 250/498] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:15.255760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.281560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.283371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 249/499] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:15.284610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66ba4-7bf0-45fc-b796-769778d15031 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.284903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66ba4-7bf0-45fc-b796-769778d15031 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.285180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc66ba4-7bf0-45fc-b796-769778d15031 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.286553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 250/500] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:15.295826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc66ba4-7bf0-45fc-b796-769778d15031 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.351316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.361097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4813fb-d7c2-4aec-bb11-e91365449539 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.390515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc66ba4-7bf0-45fc-b796-769778d15031 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.395967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.396757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.397040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.397316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.407196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.408652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.424324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.424995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.425283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.425600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.426456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:15.426773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:15.427073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.427867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.428697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:15.428697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:15.428697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.428697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:15.428920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e054-85b9-4ddc-8f8f-8b5f8fc4fd55 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.432877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 251/501] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.433634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.464340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 251/502] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:15.465601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.465918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.466203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.482581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:15.483772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:15.512805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.534366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a8dac-ac8b-4d48-923b-ec1fd27917bf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.561896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 252/503] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:15.561896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.580969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.581756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.582614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.582888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.590116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.591536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.600304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:15.607834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.608714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:15.609609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 252/504] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.610214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.654993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd78645-7604-46e4-a438-e5d669a00846 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.688771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.689565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.689872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.690152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.700529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.702001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.709756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b47391-a7e9-45b5-8646-2c04e6cad433 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:15.719691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.720567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.721398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:15.721398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:15.721398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:15.721398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:15.721398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 253/505] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.721662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.745571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.746261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.746540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.746812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.747523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:15.747826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.749179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.755932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.760989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 253/506] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:15.761750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.822504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac623d-a821-4d8a-8b19-080e0a01965b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.824074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:15.856560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.857196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.857479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.857754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.860451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12dd4-22f8-4677-9abc-ae924c759b5f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:15.895716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:15.896493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:15.896769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:15.897040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:15.907005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:15.914637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:15.915593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:15.916410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 254/507] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:15.917052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:15.927817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:15.929259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:15.978647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.020586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d5f1b0-962f-4652-84c9-f1d52bd3de8b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.029505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 254/508] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:16.030525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.035861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.053895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.054628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.054912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.055187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.056018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:16.056329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.057745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.093430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 255/509] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:16.094252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.131366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7aa73-70c1-4a20-8373-3a2a1f783cc9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.164854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.165541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.165871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.166151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.166864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:16.167173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.168542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.180394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 255/510] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:16.187855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.201000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3d26a-5102-4e53-be18-623d23791993 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.217151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.234805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.235654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.236185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.236658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.242947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.245109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.246657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:16.261567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:16.262652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 256/511] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:16.263538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.286349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1ecd5e-afbb-431b-b33d-dc277ebacf91 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.319584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.320249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.320535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.320813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.321554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:16.321872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.323258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.331465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 256/512] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:16.332287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.361348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e736f7-6f5b-423f-80db-c255af2b3070 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.394804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.395583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.395871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.396146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.405980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.407423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:16.425070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:16.426626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 257/513] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:16.427873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.432217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7392f-69e1-4789-bfbb-e3e97a37b985 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.454783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.456682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.466990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.470908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.470908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.470908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.526172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f675e-ecee-4ece-aea8-17decaded386 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.537247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.538726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.558901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.559553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.559840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.560117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.560819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.562282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.618706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 258/514] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:16 2022] POST /identity/v3/users => generated 247 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:16.619446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.635831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 257/515] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:16.636703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.664862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.736390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.751125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b07af-c421-4d19-9ce0-9678fb88fe6c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.756898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa86d-e7e1-40cb-8b26-4e23fbcf8727 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.796447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.797881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.797881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.798134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.804655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:16.805367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:16.805653 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:16.806639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:16.806833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:16.807140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.810495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.812008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:16.815011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:16.834786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 259/516] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:16.839939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:16.842219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:16.843346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:16.844194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:16.844194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:16.844194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:16.844194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:16.844400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:16.845692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:16.934504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:16.960751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e78e1e-a0fb-44ac-aaaa-6585fdff9d8b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:16.964150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d6af4-0de2-4bae-a4ae-0c881dc799fd None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.008980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.009782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.010096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.010374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.024862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.025531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.025812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.026097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.026199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.026828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:17.027134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.027813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.028510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.042665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 260/518] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:17.043690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:17.049347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:17.050223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:17.051078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:17.051078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:17.051078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:17.051078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:17.055390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.055559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:17.057201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.171232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccb288-39ca-4013-90a2-388f0dd90044 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.180517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d96560-69c0-4709-a171-1f042f18ade0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.212117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.220451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.221015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.221469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.221887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.222237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.222726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.223146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.223302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:17.223651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.224362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.225384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.246027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 260/520] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:17.247210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.309595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.311106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.312989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.359827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cbb6e-c161-4f92-a12c-0d3edbfbfc95 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.396688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.397874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.398365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.398824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.406284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.408041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.415768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 261/521] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:17.416605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:17.423847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:17.424679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:17.425767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:17.427889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 261/522] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:17.428834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.482654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.530209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0101515-bd37-430c-9f96-1dee22f49f95 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.532071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.537322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7615ea-8b38-4d97-8b13-91c92f576fbf None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.568726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.569392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.569681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.570002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.570791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:17.571031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.572393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.574257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.575049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.575335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.575610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.583821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 262/523] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:17.583942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.585098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.588737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:17.600340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:17.601246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 262/524] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:17.602889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.703677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a27e8c-3ecc-4080-a1a4-8e9686e88d2c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.710740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77750b-3c7b-410a-8ede-be30268e7dfc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.720381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.742448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.742448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.742448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.742448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.747240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.747900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.748190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.748469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.749290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:17.749613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.751102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.751611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.753037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.774626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 263/525] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:17.774626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:17.774925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:17.776188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 263/526] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:17.777323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.794915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:17.887342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bdc16-cd8d-4a1a-9e9b-76f3d792a429 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.890025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b29b0c-d974-4a64-9300-406ef08397bc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:17.922760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.923842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.924133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.924498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.924860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:17.925525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:17.926389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:17.926670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:17.927509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:17.927826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.929259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.932215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:17.933769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:17.950938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 264/527] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:17.950938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:17.951205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:17.952138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 264/528] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:17.953102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:17.990454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.027489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.056918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf837ed8-b85c-43dd-a4a6-6ac3034dd687 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.069598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff519c0-7946-46c7-b400-5f769ea910ca None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.092252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.092899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.093182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.093459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.094329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=52be421a60704a2f83174973f5d9cfcf) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.094641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.096051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.109888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 265/529] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/role_assignments?user.id=52be421a60704a2f83174973f5d9cfcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:18.109888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.114277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.115047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.115405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.116026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.116849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.117254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.118792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.136347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 265/530] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:18.137442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.237622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7177236-1fd6-440a-820f-afab480f1a2a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.243525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.258989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16333d14-284c-4830-875b-09cbe6966232 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.291433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.292188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.292477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.294008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.297995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.298388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.299055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.299492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.299721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.301712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.301712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.302837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.317741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 266/531] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:18.318619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.392383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.393896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.445685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526489e9-c39b-4538-a775-a6be82178dbf None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.481871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.482731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.483059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.483334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.491561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.493226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:18.513397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:18.514464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:18.515496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:18.518602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 267/532] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:18.520065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.532162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.533986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 266/533] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:18.535628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.573036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.646310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16c447-1d57-4688-99ae-243a6d9e446d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.648130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef310c67-09aa-4c20-b8a9-9627b496f35a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.683104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426043-fa29-4b21-a590-e243b995736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.683913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426043-fa29-4b21-a590-e243b995736f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.684293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426043-fa29-4b21-a590-e243b995736f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.684665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63426043-fa29-4b21-a590-e243b995736f None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.685205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.685748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426043-fa29-4b21-a590-e243b995736f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.686200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426043-fa29-4b21-a590-e243b995736f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.686521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.686939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.687351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.688012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63426043-fa29-4b21-a590-e243b995736f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.688471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.688936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.690619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.697709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 268/534] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:18.698709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.721658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 267/535] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:18.728192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426043-fa29-4b21-a590-e243b995736f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.783819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.820066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ded06-b6c4-4055-8b33-90eccd95122f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.862079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.863933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.864372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.865276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.878797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:18.883955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.885926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.886562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63426043-fa29-4b21-a590-e243b995736f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-41ff0f25-8cd7-4d06-af89-255e10029cb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:18.905395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:18.906662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:18.907490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:18.907490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:18.907490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:18.907490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:18.911376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 269/536] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:18.912741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922b0fb-b319-448b-9c01-59f037cac19f None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.913028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922b0fb-b319-448b-9c01-59f037cac19f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.913302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922b0fb-b319-448b-9c01-59f037cac19f None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.918576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 270/537] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:18.918576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922b0fb-b319-448b-9c01-59f037cac19f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:18.947211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:18.948727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.949300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.949758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.951462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=eb1e0a3ad767472cafc4ce0ede2f6a03) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:18.952234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:18.953904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee3296-dc1e-49f3-9115-90419fd88c04 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:18.962215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 268/538] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/role_assignments?user.id=eb1e0a3ad767472cafc4ce0ede2f6a03&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:18.963754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:18.964211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:18.964649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:18.988552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:18.990386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:19.112003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 269/539] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:19.116938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922b0fb-b319-448b-9c01-59f037cac19f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.142880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:19.155602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.156291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.156633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.162912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:19.162912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:19.162912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:19.162912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:19.164358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.182300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 271/540] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:19.187691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.328026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:19.340674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7e3e3-73a0-46ac-a5c7-40d3d5396333 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.397964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b48ac17-dc39-4f55-bf70-6f5b1f63c9fb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.430915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.431730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.432019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.432298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:19.435392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.436186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.436472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.436751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:19.448099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:19.449562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:19.456073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:19.469137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:19.470090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:19.470865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 270/541] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:19.480285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:19.481088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:19.481937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:19.482758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.484578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:19.490948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.576837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:19.659253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9956df-fb0c-4a6b-8222-28b7c23a2830 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.675971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cd51f-7210-44ef-8487-ab3771de4e26 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.725199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.727355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.728976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.729497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:19.731357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:19.732992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:19.734574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:19.749619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:19.750669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.751595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.752112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.752592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:19.753577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:19.755230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:19.756854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:19.758965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.770643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 273/544] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:19.776507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:19.798200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:19.943970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6d61d-728d-4076-87bf-c041bdcf0429 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.956645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c97bd-b5ca-4565-a151-7fa89388d1e7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:19.966929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:19.997750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:19.998587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:19.998870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:19.999144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.023264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:20.024756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:20.037953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:20.038627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.038913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.039187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.040021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=05b58dde8d4a426ead9dda4363cb82a1) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:20.040329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:20.041738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:20.048100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 274/545] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/role_assignments?user.id=05b58dde8d4a426ead9dda4363cb82a1&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:20.050681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:20.051512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:20.052425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:20.052425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:20.052425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:20.052425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:20.054916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 272/546] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:20.060917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.220604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4d902-d00c-4672-9d71-882928800e03 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:20.273068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:20.273737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.274046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.274322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.275041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:20.275347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:20.276698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb6d6d-5eda-41a0-9e4a-6c4d14ba53a8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:20.293229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 275/547] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:20.299053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.367386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea5ec-0aca-4846-8247-9471057a5969 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.367714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea5ec-0aca-4846-8247-9471057a5969 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.367929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ea5ec-0aca-4846-8247-9471057a5969 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.369679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 276/548] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:20.374766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.375048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.375413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.390235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:20.416002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:20.417263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:20.434479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e09afd-ac3c-407b-a36d-514fa20012e7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:20.443849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:20.507406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:20.508124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.508405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.508677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.526503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:20.529964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:20.536412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 277/549] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:20.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:20.555839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:20.557337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 273/550] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:20.559051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.562554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.687890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddf265-b8ec-4231-8471-a753848fb31f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:20.712353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:20.733215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:20.733922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.734210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.734489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.735345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:20.737677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37d41-2d22-4302-b870-d2020474df53 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:20.739765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:20.741547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:20.780157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 274/551] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:20.791943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.812601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:20.813806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:20.814322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:20.814847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:20.844633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:20.853054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:20.854020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:20.854883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:20.862688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 278/552] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:20.870802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:20.913474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:20.936301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9154e31-ee31-4743-934e-d355e1383caf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.010960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2939c-2fa4-4d83-b479-1bb94a59cdc6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.021829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.022513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.022801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.023083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.050863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.052367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.053105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.053791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.054849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:21.055357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.056977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.067444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 279/553] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:21.072331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.119230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.133975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.136370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8bfc-f254-43c8-b109-d4f6661caf0c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.212398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.235784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991ab6d-564e-4986-a957-bd71adc99af1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.272961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 275/554] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:28:21.272961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f331c-4d8c-4a08-b6a0-5d30bf0b5e58 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.272961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f331c-4d8c-4a08-b6a0-5d30bf0b5e58 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.272961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f331c-4d8c-4a08-b6a0-5d30bf0b5e58 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.274125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 276/555] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:21.275063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f331c-4d8c-4a08-b6a0-5d30bf0b5e58 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.289440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.290273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.290564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.290845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.304829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.306542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-49a618cc-0135-4d55-af5a-48e733280587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:21.331236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:21.332179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:21.333110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:21.333110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:21.333110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:21.333110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:21.333110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 280/556] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:21.334240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.334531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.334808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.356168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:21.357532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:21.381808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.402056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f331c-4d8c-4a08-b6a0-5d30bf0b5e58 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.445883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 281/557] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:21.445883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.454551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.455496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.455850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.456197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.467219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.469197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e941eb69-527a-4392-8ac3-5905ccff0c35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:21.488990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:21.490582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:21.491949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:21.491949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:21.491949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:21.491949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:21.494159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 277/558] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:21.495841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f901-9727-4ffb-b7ff-7c7c595d4e21 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.496757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f901-9727-4ffb-b7ff-7c7c595d4e21 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.497041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9f901-9727-4ffb-b7ff-7c7c595d4e21 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.498482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 278/559] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:21.499216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f901-9727-4ffb-b7ff-7c7c595d4e21 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.516741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.560034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef3b29-b9c9-48ee-9d06-e44bcd52c2c2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.598112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.598900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.599273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.599653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.600579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:21.600997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.602539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.604852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9f901-9727-4ffb-b7ff-7c7c595d4e21 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.620879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 282/560] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:21.620879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.644905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.645808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.646185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.646527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.648440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.658400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-95043aa8-f309-4ff4-9882-8fb714a0cd13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:21.666785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:21.667967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 279/561] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:21.669204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.670035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.670035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.687660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:21.688831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:21.734036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aadb4-a988-4068-8e6f-54f423b7b1a7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.758616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.769871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 280/562] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:21.769871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.782233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.782984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.783338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.783682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.785607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:21.786016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.788203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.805895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 283/563] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:21.809903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.869309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb7991-2aa8-4c9e-8318-283ac755f34a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.894554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:21.905332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.906165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.907241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.907241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.915489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.917835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.922144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db48c-0a82-4759-9fc7-5975dc749498 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:21.933153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:21.934328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:21.935293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 281/564] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:21.935880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:21.961574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:21.962449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:21.962862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:21.963241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:21.964085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:21.964496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:21.965999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:21.976390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:21.976390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.027743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.052928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01dcea-bd66-4091-895d-1d3b6ca30c5f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.084392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7ff47-fb95-4262-9008-76893bae1102 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.090268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.091132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.091502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.091848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.102924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:22.110648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:22.111576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:22.112420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:22.116957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 282/566] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:22.117808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.125932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.126652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.126935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.127205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.133921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.135354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:22.149882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:22.150747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:22.151606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 285/567] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:22.152077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.171655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.230231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8697c0c-10ec-4f9b-90c9-ee764205ec8e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.256196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59113fdd-9d18-4f62-9727-8726b4673393 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.258615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.266124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.266814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.267113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.267398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.268225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.268545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.270514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.289663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 283/568] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.290654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.296036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.298068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.298380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.298666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.308896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.310386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:22.328135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:22.329202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 286/569] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:22.335209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.395949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb811fe-ff68-4cfe-b607-a137d4c70374 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.398420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.431287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.432218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.432505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.432785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.432876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d4fcf-f8c2-467c-be02-c351d5e8529a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.433531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.433841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.435229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.447975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 284/570] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.447975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.467379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.468031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.468320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.468598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.469379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.469690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.471129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3264c3-c2e6-45e8-a1c2-c7b817382adc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.482433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 287/571] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.483668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc91-8b09-4911-a91d-e4934420c27d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.483960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc91-8b09-4911-a91d-e4934420c27d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.484238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51dc91-8b09-4911-a91d-e4934420c27d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.487259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 288/572] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:22.487259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51dc91-8b09-4911-a91d-e4934420c27d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.505007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.547093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3829fe-c91c-4a7b-a35a-ffbe8e843c47 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.580397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.581185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.581473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.581749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.586949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51dc91-8b09-4911-a91d-e4934420c27d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.592650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.594147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:22.610802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:22.611758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:22.612817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:22.612817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:22.612817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.612817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:22.612817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 285/573] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:22.613473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.621718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.622428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.622713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.622991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.623712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.624025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.625386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.631572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.636969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.637763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.712665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585c2b-9356-4133-8f0c-6b7187199bdc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.716192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.738952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384de5e-335f-481e-97b4-4d5da48105b3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.746066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.746859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.747144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.747422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.758405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.759846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.772561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.773201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.773481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.773750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.774595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=596a616025ee4112af72d799216c2fcf) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.774902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.776302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c5e4de97-801b-42b1-a636-8cbd12d9fa80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:22.776459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:22.777484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:22.778448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:22.778448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:22.778448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:22.778448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:22.778448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:22.779100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.779386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.779665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.791606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/role_assignments?user.id=596a616025ee4112af72d799216c2fcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.791606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.796727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:22.798014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:22.868542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.875594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 287/577] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:22.882017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:22.930546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aeeda6-f1f6-4336-8eac-f0347fecee6e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:22.969559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:22.970191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:22.970480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:22.970906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:22.971935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:22.972041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:22.976050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:22.984411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:22.993106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 291/578] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:22.993106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.001454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e9a28-97fb-4225-b397-bf42b2cd7a44 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.040079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.041156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.041444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.041725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.051450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.053022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:23.067737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:23.068730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:23.069696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.103223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac78f1-d433-4277-a4f9-3ee2b4ade463 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.138565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.141660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.142353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.142639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.142917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.143632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:23.143945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.145362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.161298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 292/580] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:23.161298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.200649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ad0e-b375-4c42-9a1e-111990ac6522 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.273145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.281021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.281814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.282120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.282390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.293558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:23.301782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:23.302977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 289/581] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:23.304339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.319993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc5393-48cc-4baa-bd54-7d31fda7b3dc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.356594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.357387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.357827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.357961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.365643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.367367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:23.381768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:23.382667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:23.384092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.415161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13fad9d-6e6e-419c-9bd0-4f00d9303e87 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.434764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.453269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.453973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.454584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.454584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.455365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:23.455718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.457803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.480237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:23.480237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.493926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f42e42-83c2-4f69-8ddb-eb3fbe6be371 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.514969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.529604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.530367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.530650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.530928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.538689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.540128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:23.555179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:23.556082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:23.557011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 294/584] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:23.558048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.587853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdf51c-984a-4959-84e6-3ae794719870 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.623589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.624285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.624574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.624856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.625602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:23.625965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.627332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.635947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 291/585] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:23.636542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.672256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1024-11da-43f4-98a3-cf9fb45286b3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.680625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.708111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.708894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.709183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.709457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.710263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:23.710572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.712294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.730175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 295/586] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:23.730175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.741942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a844fa7-6d8a-4ab7-bb4f-e2fb11da3e09 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.777165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.777452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.777972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.778261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.778539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.792786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.792786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:23.809370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:23.810391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:23.811289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:23.811289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:23.811289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:23.811289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:23.811289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 292/587] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:23.811988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.842899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ec0a8-de2e-4735-991c-278f37a76edf None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.881625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.882327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.882672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.882949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.883844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:23.884158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.885562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.908072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 296/588] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:23.908072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:23.919544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:23.929689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb6fa8-b388-471f-871a-7d9da6630698 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:23.967214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:23.968223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:23.968503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:23.968778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:23.980319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:23.981763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:23.999614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:24.000597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 293/589] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:24.002112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.017753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.022136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41db7c-ecfb-4740-8dbd-56de0267da3d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.059536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.060347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.060630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.061071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/52be421a60704a2f83174973f5d9cfcf/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.075851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=52be421a60704a2f83174973f5d9cfcf, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.077281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.104611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f2d8a-0e42-4149-a45e-60439b19bc34 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.137116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.137767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.138076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.138349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.139060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:24.139365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.140711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.152116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 294/590] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:24.152871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.157203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.191421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 297/591] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:23 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/52be421a60704a2f83174973f5d9cfcf/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:24.192862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.281282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e5be2-f36a-4484-a33a-b3291e2a4df0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.329015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.330172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.330531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.330879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.332972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec9826a-5cfc-4731-95a0-7d1853d253c8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.345190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.348057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:24.368426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:24.369458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:24.370598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:24.370598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:24.370598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:24.370598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:24.370598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 295/592] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:24.370942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.378090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.378911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.379204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.379479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.380210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:24.380517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.381906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.396314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 298/593] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:24.399114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.411716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.442203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.502514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb503eb5-a4ba-4074-a8e9-0fab7edddb92 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.525036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a627-5bba-4eed-9b5e-c16f36e71b75 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.548918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.550013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.550298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.550766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.559203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.559870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.560001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.560162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.560440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.561165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:24.561336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.561497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.562982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.576119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 299/594] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:24.576978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:24.579967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:24.580827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:24.581689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:24.582705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.657766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.702679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0d53-f694-472e-b060-beb15ce3b73c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.704873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35152d-3b55-4fda-b991-8538343714d6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.720176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.744594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.745581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.746000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.746279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.746982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.747777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.748319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.748606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.755908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.757369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.757990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.759880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:24.773551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:24.774484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:24.775405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 300/596] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:24.776449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:24.781885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:24.783837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 297/597] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:24.786165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.887192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad97660-b99e-47e0-be2b-e4387e45589b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.901021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a69185-1381-4f94-93ad-6587b05d7344 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:24.919441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:24.929378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.930099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.930533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.930822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.932200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:24.932521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.936367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.936482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:24.936482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.936651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.936959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.937800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:24.938138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:24.939532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cbb31-cc6e-4bdf-8d4a-d06f1a51f226 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:24.949896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 301/598] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:24.950923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:24.958333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 298/599] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:24.961626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a6b0-b4c4-4aa6-bcad-624597fac581 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:24.962023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a6b0-b4c4-4aa6-bcad-624597fac581 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:24.962439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583a6b0-b4c4-4aa6-bcad-624597fac581 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:24.963804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 299/600] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:24.964595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a6b0-b4c4-4aa6-bcad-624597fac581 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.002380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:25.077266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc0fe06-bcb1-4801-a5ed-be3b703c7a54 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.079371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583a6b0-b4c4-4aa6-bcad-624597fac581 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.114859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.116087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.116370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.116467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.116653 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.117055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.117439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.117809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.118699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:25.119019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.120500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.131947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=99eac0e91e884f4c8e1c93f7f66d43a5, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.133362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154f2dd-0c69-432f-9edf-091e583ac23c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.133717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 302/601] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:25.134861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.184459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:25.213338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 300/602] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:24 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:25.223493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.223849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.224041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.236058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd8f68-5294-433a-a9fb-b05dd7dfc8ed None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.264597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:25.266900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:25.290799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.291975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.292334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.292710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.313834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.316850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:25.337777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:25.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:25.339879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:25.339879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:25.339879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:25.339879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:25.344240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 303/603] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:25.345178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.384690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 301/604] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:25.385798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.401186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:25.470043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:25.475733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7895adb0-5351-46e4-b3b3-ec5eb997efcb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.503419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9e5ef-c860-42c7-859d-e75dc576f622 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.523641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.524804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.525633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.526105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/eb1e0a3ad767472cafc4ce0ede2f6a03/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.540429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.541179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.541375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.541648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.542659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:25.542780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.544170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.546026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=eb1e0a3ad767472cafc4ce0ede2f6a03, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.548072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.556729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 302/605] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:25.557514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.608690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 304/606] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:25 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/eb1e0a3ad767472cafc4ce0ede2f6a03/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:25.615483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.681906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:25.735294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c231a-48bb-4603-a7b9-8650c5087b3c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.783317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a83d4d-047f-4b2b-8a63-d219c2dfe199 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:25.799002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.799825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.800108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.800384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.822905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:25.832307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:25.833467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:25.834518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 303/607] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:25.841259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.844067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:25.845106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:25.845769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:25.846226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:25.856386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:25.858549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:25.879944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:25.881070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:25.882261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:25.883830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 305/608] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:25.889026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:25.903237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.012443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800a4c-1ab1-4f89-8d5e-07193b25464d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.052057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.053454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.054004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.054508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.055620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:26.056133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.057782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.071981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 306/609] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:26.078038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429dcf7b-be97-4a1d-ac45-56405a3678b9 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.079106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.136762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.146969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.147881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.148305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.148718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.154244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:26.161454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.161454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.170204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 304/610] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:26.179663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.210229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.262011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774da6d-3d0d-4a02-a64d-bf8089ea31e7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.327747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.328915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.329359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.329640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/05b58dde8d4a426ead9dda4363cb82a1/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.338597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f78f10-a557-413f-b9b7-6ae405cdfa86 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.361953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=05b58dde8d4a426ead9dda4363cb82a1, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.363430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee330c-c11a-4909-96e5-22b11b235581 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.379397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.380192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.380473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.380742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.391393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.392866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a3188630-5ea2-44a3-8007-8348c9262306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:26.411607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:26.412517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:26.413407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:26.413407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:26.413407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:26.413407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:26.413407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 305/611] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:26.421683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563411b-683d-4dee-900c-5b6d6c74ad19 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.421683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563411b-683d-4dee-900c-5b6d6c74ad19 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.421683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563411b-683d-4dee-900c-5b6d6c74ad19 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.421683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 306/612] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:26.421683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563411b-683d-4dee-900c-5b6d6c74ad19 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.436976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 307/613] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:26 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/05b58dde8d4a426ead9dda4363cb82a1/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:26.442598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.443006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.443408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.485101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.491152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:26.492586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:26.554775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563411b-683d-4dee-900c-5b6d6c74ad19 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.596431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.597681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.598286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.598708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.599581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:26.600275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.602350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.616770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 307/614] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:26.627917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.687852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 308/615] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:26.718958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.770728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca94b6-e855-4c88-8ca4-c3911856f2b0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.772788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.782631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:26.807260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.808194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.808609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.808992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.822819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:26.824426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:26.827219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f9db1-ec67-46b6-afde-772ae7fece11 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:26.849802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:26.850863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:26.851770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:26.852646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 308/616] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:26.859937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:26.865038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:26.866104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:26.866401 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:26.866670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:26.877836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:26.886114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:26.887019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:26.887827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:26.892057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 309/617] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:26.893250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.014958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6108-d9ce-46e9-a083-2ce5385b1328 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.026073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.051331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.052000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.052276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.053354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.054155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:27.054487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.055829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.058945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a37fe-58df-47ef-b349-0b4904f9ceb6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.069061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 310/618] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:27.070342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.094398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.095076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.095363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.095642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.096484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:27.096798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.098775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.125785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 309/619] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:27.130868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.157446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.240036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b867dff-e08d-4bf5-9a92-e95a9a59cc51 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.264694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378d1e3-82e3-4c3d-8fa7-8831a830ffcb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.276293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.277097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.277382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.277658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.289670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.291171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:27.311492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:27.312401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:27.313276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:27.313276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:27.313276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:27.313276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:27.313276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 310/620] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:27.319020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.354401 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.355253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.355544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.355821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.377785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.379324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:27.416829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:27.417772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:27.418718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:27.418718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:27.418718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:27.418718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:27.424005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 311/621] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:27.424849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.470207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.479810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.513789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30a5c4-f15f-416b-aef1-c3b75fc0af64 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.596821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.598159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.598450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.598729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.599464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:27.599774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.601144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.603815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946306bb-3a14-4c70-a598-1a2fc0ba9006 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.630533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 311/622] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:27.634163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.675628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.676348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.676637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.676910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.677811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:27.678157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.679585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404c588-394b-4174-8b32-4e28cac90b96 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.696653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 312/623] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:27.698060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d110-29eb-4e45-a4ba-51f615c28c3c None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.698353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d110-29eb-4e45-a4ba-51f615c28c3c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.698632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9d110-29eb-4e45-a4ba-51f615c28c3c None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.699909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 313/624] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:27.704703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9d110-29eb-4e45-a4ba-51f615c28c3c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.755957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450724f5-ff68-46ff-9dfd-1d16ce31f01f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.798203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.799457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.800001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.800277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.801984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.805278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:27.810193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.811657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.819908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9d110-29eb-4e45-a4ba-51f615c28c3c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-fb1721fb-c9c2-41e6-850a-b6316482a115 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:27.827189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:27.828101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:27.828955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 312/625] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:27.832581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.832581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.832581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.850948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:27.852119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:27.865648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:27.866978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:27.867565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:27.868014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:27.876506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:27.879325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:27.897514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:27.898561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 03:28:27.899503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:27.906289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 314/626] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:27.907340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:27.927390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 313/627] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:27.928467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.043842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de23887-7e70-42f4-a466-d84bab33323e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.069933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.071218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6cfc92-44fd-4929-a1de-95f7a7b2ac8f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.078085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.078805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.079086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.079358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.080197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:28.080505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.081995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.099645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 314/628] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:28.100430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.119238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.120467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.120919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.121340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.122320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:28.123232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.125322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f33e55-3408-40a6-9142-6ffe6560e54e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.143777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 315/629] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:28.145313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505a1f-9ba8-491e-aab7-bd7ed75abe65 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.145748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505a1f-9ba8-491e-aab7-bd7ed75abe65 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.146311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a505a1f-9ba8-491e-aab7-bd7ed75abe65 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.147955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 316/630] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:28.148654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a505a1f-9ba8-491e-aab7-bd7ed75abe65 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.155809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.203166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a081c5c-0090-41f2-be4b-86ba3a1f7056 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.237341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.238684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.238963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.239226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.249626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:28.257976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:28.258875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 315/631] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:28.264790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.265551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a505a1f-9ba8-491e-aab7-bd7ed75abe65 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.301087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.301736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.302073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.302324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.310423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.368977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7462b-ed10-498f-b745-561e1113cf68 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.373375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.374844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329d333-2d5f-484b-b96d-39d89163df14 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.378755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.403422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.404307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.404612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.404882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/596a616025ee4112af72d799216c2fcf/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.420643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=596a616025ee4112af72d799216c2fcf, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.422196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.476995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 317/632] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:28.478374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.478718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.478999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.497763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:28.498975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:28.510198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 316/633] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:28 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/596a616025ee4112af72d799216c2fcf/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:28.510198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.596539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 318/634] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:28.597785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.618455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.627295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ae6cc-7e97-437a-bae5-8241d081318e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.659354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.671537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.672658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.673147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.673628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.674651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:28.675198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.676849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.687913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 317/635] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:28.689161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.738630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f172d-aed3-43b3-a60b-3f35dc2400fb None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.781587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.782684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.783110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.783522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.796964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:28.798653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:28.814959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95bbff-32b6-415d-a1a7-7d7a37e86a92 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:28.822278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:28.823364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:28.824430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:28.824430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:28.824430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:28.824430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:28.826749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 319/636] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:28.832229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.863653 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.864915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.865408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.866225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:28.877973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:28.887039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:28.888132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:28.889162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:28.891252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 318/637] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:28.892249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:28.912872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.932365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:28.948959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1461b1-fe3c-4275-8d6d-7badde516a6a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:28.990505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:28.991734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:28.992119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:28.992507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.003036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.004630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.008175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fbbd5-f723-4828-afc1-39f64f63290f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ca26509e-ac9e-41f3-92e3-e19b9b4054f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:29.023128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:29.024289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:29.025429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:29.025429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:29.025429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:29.025429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:29.028926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 320/638] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:29.030166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa928-edd0-4ce6-afda-ad7537b20b30 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.030459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa928-edd0-4ce6-afda-ad7537b20b30 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.030741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaa928-edd0-4ce6-afda-ad7537b20b30 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.032189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 321/639] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:29.036915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa928-edd0-4ce6-afda-ad7537b20b30 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.051967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.053049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.053218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.053496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.054259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.054562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.055957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.068091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 319/640] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.068857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.148963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.165808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaa928-edd0-4ce6-afda-ad7537b20b30 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.173716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115e018-cd85-419d-bd39-cc974a2e138c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.202863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.203811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.204467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.204750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.205503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.205821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.207872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35241e25-f16b-4906-9e06-e1a7302510da None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.212978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.219072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.219186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.219266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.219266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.219266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.219266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.219266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.219586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 322/641] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.219586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1928-e227-47c5-8efc-79612311636c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.219586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1928-e227-47c5-8efc-79612311636c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.219586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee1928-e227-47c5-8efc-79612311636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.233242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 320/642] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.234314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.238616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-23ee1928-e227-47c5-8efc-79612311636c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:29.239808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-23ee1928-e227-47c5-8efc-79612311636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:29.311829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 323/643] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:29.312675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1928-e227-47c5-8efc-79612311636c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.350917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9a88d-efdf-4b94-8825-25500f999621 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.386827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.387878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.388162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.388437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.392033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.398120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.404269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:29.414700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:29.415912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 321/644] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:29.416799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.434106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee1928-e227-47c5-8efc-79612311636c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.464581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.470848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.471655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.471936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.472209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.482274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.483723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:29.502230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:29.503144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 324/645] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:29.504781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.529469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d62236-3ae9-4b9d-8d14-6c366357786d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.565390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.566930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.567214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.567580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.578716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.580165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:29.602255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:29.603218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:29.604133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 322/646] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:29.605157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.621110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0385a-4ae2-4ef1-b833-130718f70b96 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.670004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.672667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.673494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.673779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.674152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.686564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:29.695006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:29.696033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 325/647] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:29.697527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.723559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd545b69-fac5-4d1c-ba6e-73d915a29821 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.740222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.759756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.760432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.760739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.761007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.761796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.762147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.763559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.775207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 323/648] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.776058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.800279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be47301-7d6b-4dda-aaad-a75963a03224 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.834114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.834779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.835070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.835349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.836063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.836372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.837738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.856591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 326/649] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.856591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.887802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695ce94-8643-4063-9125-328d3d30cdf3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.920071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.920670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.920954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.921316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:29.922161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:29.922491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:29.923895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:29.940991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 324/650] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:29.941826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:29.947420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.958648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41967f8-e655-46d2-97f1-ff29e3858dbc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:29.982247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:29.997246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:29.998236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:29.998728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:29.999954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.000913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:30.001435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.003025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.011330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 327/651] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:30.017589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.058089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75457825-a72e-4687-93cd-e3b105d6de1c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.099085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.100154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.100664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.101045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.101968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=52be421a60704a2f83174973f5d9cfcf) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:30.102284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.103711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.117888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 325/652] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:29 2022] GET /identity/v3/role_assignments?user.id=52be421a60704a2f83174973f5d9cfcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:30.117888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.130369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f569d3b-010f-42f2-94fa-6ecc12c6d85c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.159225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.177913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.178671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.178958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.179239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.187935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.189584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:30.207831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:30.208876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:30.210433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 328/653] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:30.214629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.229491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c09cc-dda0-4ee8-8887-4402729b972b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.246237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.268716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.269418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.269702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.270056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.341436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988678-386f-485f-8f3e-2593f9a26d99 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.355213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.356688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.386023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.387108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.387108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.387525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.401386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.402042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.403101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:30.426669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:30.427605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:30.428517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:30.428517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:30.428517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:30.428517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:30.429014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 329/654] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:30.429974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.472126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 326/655] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:30.473121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.541008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.572220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbdb785-0309-4db1-bda1-6b1f130e3029 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.590575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384df48-ec47-4121-af7b-9254f1bd26aa None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.614421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.615401 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.615895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.616623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.617765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:30.618302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.620016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.634603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.635273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.635556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.635830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.637039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:30.637360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.638759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58091a-3e49-4a2d-8241-026d371d029e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.640163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 330/656] 10.222.0.42 () {56 vars in 1137 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:30.641307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.646182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.651272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 327/657] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:30.658885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7359e-f9a7-42f2-8c3f-b050979ce54a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.658885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7359e-f9a7-42f2-8c3f-b050979ce54a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.658885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7359e-f9a7-42f2-8c3f-b050979ce54a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.658885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 328/658] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:30.658885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7359e-f9a7-42f2-8c3f-b050979ce54a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.754422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43f4e2-a045-4fcc-8eca-ddcf64f3416d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.777776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7359e-f9a7-42f2-8c3f-b050979ce54a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.789988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.790784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.791068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.791354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.793299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.802651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.804103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.813814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.814720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.815196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.815660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:30.822386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:30.823435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:30.824421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:30.824421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:30.824421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:30.824421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:30.824421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 331/659] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:30.824711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:30.892581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:30.897124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.898863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:30.934310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc695d1-e6d1-43f6-91ad-4941e9039c7c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:30.973727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:30.974617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:30.974845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:30.975123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:30.986526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:30.988591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ac53361c-27c6-4694-ab54-91c7b7d4053e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:31.005089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:31.006085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:31.007002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 332/660] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:31.007601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.008258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.008258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.016008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 329/661] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:31.017088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.024153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:31.025349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:31.071677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.099564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 333/662] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:31.100614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.132330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.136828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce0b0c-59e3-4490-88c4-962d5e1361ee None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.180522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.181192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.181480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.181949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.183150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:31.183475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.185121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.200925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 330/663] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:31.201759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.219036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c84ed-94d1-4d3d-b7a8-131b0b1c28e0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.255816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.256420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.256707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.256986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.257824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:31.258169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.259600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.282517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 334/664] 10.222.0.42 () {56 vars in 1139 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:31.283748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.308604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c1d20-0134-441a-89da-6e42688bf4b5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.319367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.346093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.346934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.347220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.348219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.360467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.361940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:31.380146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:31.381062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:31.381982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:31.381982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:31.381982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:31.381982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:31.381982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 331/665] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:31.382297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.396634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.396781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f635-6c21-4012-b191-10e8df7753c7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.432517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.433308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.433591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.433888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.444320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:31.451933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:31.452868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:31.453691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 335/666] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:31.454729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.498591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da2448-ac3f-49a1-a687-db5cd6b8d03d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.534366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.535344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.535843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.536244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.543555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.544980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.557480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:31.558894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:31.559743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:31.560617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 332/667] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:31.561143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.570324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3a98-bdc2-49d0-8725-3b2284bfd969 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.605752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.606829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.607135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.607412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.637608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.668893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db00033-8aab-4526-9d16-c658ed205076 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.677262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.678753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.706025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.707543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.707847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.708239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.708970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:31.709284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.710672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.727357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 333/668] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:31.727357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.777886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.785912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 336/669] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:31.786672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.840005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143bb6e-6fb2-424b-ad75-ca4078e73d46 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.871267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:31.877197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.877904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.878209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.878477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.879816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:31.880130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.881503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.890302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 334/670] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:31.891096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:31.891623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2062286-1a4f-49a5-a660-f71bbd724621 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:31.930371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:31.931096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:31.931385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:31.932296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:31.932456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:31.932756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:31.934227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:31.947759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 337/671] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:31.949084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.008085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a39fb-0945-4451-bbdd-83c094bf22a7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.014150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.044638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.045356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.045667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.046011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.054098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.055545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.063683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c02bd-e7cc-4791-b3e6-0a585ebe92c2 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:32.070433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:32.071315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:32.072180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 335/672] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:32.073601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.103965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.105118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.105626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.105997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.117639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.119180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.129355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:32.137007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:32.145305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 338/673] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:32.146537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.184753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a1312-6581-48ab-9f2f-031bc9087050 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.219542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.220379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.220692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.221008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.232753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.234280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.247939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12daa0-bd0b-49c8-a9ef-f1d3e006e64e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:32.252301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:32.253187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:32.254143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:32.254143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:32.254143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:32.254143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:32.256303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.258278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 336/674] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:32.258964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.286989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.287648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.287937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.288220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.289051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:32.289370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.290892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.296820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 339/675] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:32.297536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.368856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1447b-b982-4161-b4a6-bf2c3363b570 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.371399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.406379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.407054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.407346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.407628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.408436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:32.408751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.410274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.415346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74c1aaa-7e4d-4551-95fd-ab91f8900de3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.423333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 337/676] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:32.424190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.463193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.463862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.464152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.464431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.465153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:32.465464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.466861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d79e8c-eb4d-4f71-a23e-ca41311194ac None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.480926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 340/677] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:32.482247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6c6b-376e-4a41-b665-08b81a34cccc None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.482538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6c6b-376e-4a41-b665-08b81a34cccc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.482841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba6c6b-376e-4a41-b665-08b81a34cccc None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.484186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 341/678] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:32.484730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6c6b-376e-4a41-b665-08b81a34cccc None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.524594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.551817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06719b7-fe5e-47bf-8b06-056d9dcd5467 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.591811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.592478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.592766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.593049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.593911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:32.594105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.595461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.603929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba6c6b-376e-4a41-b665-08b81a34cccc None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.612337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 338/679] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:32.612337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.639144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.643983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.644672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.644958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.645243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.646209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=eb1e0a3ad767472cafc4ce0ede2f6a03) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:32.650593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.650593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263315-66ea-4d44-b453-e4acbecaa6f5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.662303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 342/680] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/role_assignments?user.id=eb1e0a3ad767472cafc4ce0ede2f6a03&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:32.663567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.663858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.664137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.690305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:32.693322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:32.737106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909e708-e1a6-4a19-bf9d-9d65d34ca868 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.787290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.788277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.788904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 343/681] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:32.790014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.794072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.795475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:32.810835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:32.812729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:32.829819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:32.832878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:32.833738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:32.834743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:32.836686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 339/682] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:32.837396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:32.935801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88d968-477b-41a6-a7a7-1d94946e2e24 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.959204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6dbb7d-caa9-49c3-a983-9bb9795bd748 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:32.961438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:32.988574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:32.990076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:32.991471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:32.992566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.004431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.005945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.009038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.010110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.010614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.011101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.022924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:33.023991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:33.024899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:33.026250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 344/683] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:33.027983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.030535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:33.048429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:33.049377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:33.050328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:33.050328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:33.050328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:33.050328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:33.054466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 340/684] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:33.055373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.143214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.159659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a0dc7-8057-4abe-9967-b603a3d828ef None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.174821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8329ff-3479-4921-91ad-285b9c86068f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.195806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.196534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.196823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.197094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.197881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:33.198199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.199615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.212936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 345/685] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:33.213954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.225971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.227354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.228142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.228623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.229957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:33.230899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.233140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.237008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.255076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 341/686] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:33.256214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.318621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82f651-92ea-4872-b9e8-50768ebd002c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.352995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.353653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.353983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.354260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.355195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:33.355322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.356606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.364958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3597c-deea-420a-9382-6e4c5a2380ca None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.373930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 346/687] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:33.374825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.378586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.403272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.404621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.405174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.405681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.406743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=05b58dde8d4a426ead9dda4363cb82a1) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:33.407326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.409055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.416858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 342/688] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/role_assignments?user.id=05b58dde8d4a426ead9dda4363cb82a1&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:33.426521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.484975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ea804-2750-4db1-9390-26eda71d707e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.533879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.535656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.536157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.537101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.573450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.636300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea385-8f0b-4b0f-b24c-d70dea54b679 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.655710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.657448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.661374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.684488 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.685816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.686388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.686832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.687964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.690037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:33.777400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 347/689] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:33.786944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:33.809009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 343/690] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:28:33 2022] POST /identity/v3/users => generated 254 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:33.907692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75f6d7-04f0-4651-8eb7-30a7822f1444 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:33.911210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:33.953659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:33.954813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:33.955268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:33.956007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:33.972946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:33.974674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:34.001893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:34.003001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:34.004126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:34.004126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:34.004126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:34.004126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:34.006623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 348/691] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:34.012318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:34.146694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b40bd-38f2-4fcd-9379-44e3590e0a7e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:34.163549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:34.183841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:34.188136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:34.200517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 344/692] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:34.205931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:34.318386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733dfb1-4f45-4dc1-b47b-570a6b4eccbd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:34.356348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:34.357157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.357495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.357768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.364947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:34.366685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-8e56babe-d609-4598-bf0e-c64d534ff174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:34.381892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:34.382883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:34.383759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 349/693] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:34.390805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:34.512502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdd789-33fc-4415-a3f1-c1d2148b686c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:34.564358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:34.565029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.565311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.565588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.566942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:34.567251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:34.568666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3bde8f-2354-4e58-9838-755584b10ab3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:34.575292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2808-af74-4f27-9ace-d305baf6e9c7 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.575863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2808-af74-4f27-9ace-d305baf6e9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.575863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c2808-af74-4f27-9ace-d305baf6e9c7 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.577480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 350/694] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:34.587552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 345/695] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:34.594889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2808-af74-4f27-9ace-d305baf6e9c7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:34.596923 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.597493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.598358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.630183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:34.635889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:34.637333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:34.697710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:34.774640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 346/696] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:34.791549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c2808-af74-4f27-9ace-d305baf6e9c7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:34.830145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:34.837672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:34.838744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.839300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.839819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.840874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=596a616025ee4112af72d799216c2fcf) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:34.841389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:34.843117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1ccd1-805a-4a60-932c-e35793a8db74 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:34.850763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 351/697] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:34 2022] GET /identity/v3/role_assignments?user.id=596a616025ee4112af72d799216c2fcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:34.924087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b77db-22bc-401f-a9a4-2b19706f8f35 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.924624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b77db-22bc-401f-a9a4-2b19706f8f35 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.924906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b77db-22bc-401f-a9a4-2b19706f8f35 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.926745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 352/698] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:34.952885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:34.952885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:34.952885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:34.990094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:34.991559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:34.995297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106d6eb-4a8a-4ff1-bca6-b1785b1c0a73 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.048833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.049565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.049845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.050139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.074523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:35.083863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:35.084817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:35.086068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 347/699] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:35.091485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.098521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 353/700] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:35.122510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.123164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.137457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.219314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159b421c-335f-4b6d-8f6d-3e28e4c359d1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.240305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa050518-8e1d-4123-9ed9-4a3eb8cb2076 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.256172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.257120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.257601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.258126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.259064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:35.259564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.261107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.274901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 348/701] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:35.276368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.277963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.278833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.279113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.279427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.280078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.282183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:35.297220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:35.298245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:35.299563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 354/702] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:35.305347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.370594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.386443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ec671-f288-4035-abd2-2d4a480791f3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.391421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.417291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8300adf-7a8c-4073-a85a-4e79a0cdde3a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.423120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.424188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.433961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.433961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.436714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.438405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.454646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.455359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.455644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.455920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.456788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:35.457609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:35.458885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:35.459796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:35.461070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:35.461070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:35.461070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:35.461070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:35.461284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.465093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 355/704] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:35.465385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 349/704] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:35.469055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.470961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.576887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f29b-f5a9-47a6-a761-e558987b4e8c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.578493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa3cd4-624a-4128-87de-65a13e8c21d7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.616041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.621292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.621292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.621292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.621502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.621606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:35.621679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.621747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.621813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.621813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.621813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:35.621813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.622087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.622154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.629537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 350/705] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:35.634299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.641962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 356/706] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:35.648567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.657880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:35.812173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f81236-d94a-4bff-8e99-af1289de085e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:35.864678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:35.865538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.865824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.866154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.881242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:35.882736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-2f7d8110-bc97-4cf8-91d4-aa80500fa9fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:35.902761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:35.903746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:35.904906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 351/707] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:35.911880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:35.985153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5925f-b74f-4433-ab09-7badab871454 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.985453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5925f-b74f-4433-ab09-7badab871454 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.985707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5925f-b74f-4433-ab09-7badab871454 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:35.987797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 352/708] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:35.993740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:35.994034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:35.994312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.013210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:36.014961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:36.043385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fb6b9-6ae2-40bd-8768-6cbea7cb2a14 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.082673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:36.092618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 353/709] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:36.115278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:36.127540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.128218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.128526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.129342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.130213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:36.130528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.132045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.160404 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 357/710] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:36.166934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:36.269446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:36.312827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68087477-4d1e-4a1b-8197-dd6e81a1e3a7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.351610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea9366-d336-47e7-8b16-f846aaa4629e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.353896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.354394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.354667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.354953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.355600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.356968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:36.371745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:36.372747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:36.373818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 354/711] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:36.378617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:36.438706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:36.448147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.448811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.449103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.453224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.523190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502a202-0234-4b84-adc6-e39037f87ab3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.543047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.544962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.606293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:36.607955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.608635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.608919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.609199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.609945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] RBAC: Adding query filter params (name=network) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:36.610258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.611639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.633325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 355/712] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:36.633325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:36.671937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 358/713] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 03:28:36.677495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:36.737011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d5b722-c6e9-486f-8991-8fcb98cbbefb None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.781879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:36.781879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.781879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.781879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] RBAC: Adding query filter params (type=network) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44494ef-deb0-442a-8291-b426936fde8f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 356/714] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:36.796968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce881a5-0fa6-400a-be05-1de6f9c98149 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.797524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce881a5-0fa6-400a-be05-1de6f9c98149 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.797524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce881a5-0fa6-400a-be05-1de6f9c98149 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.797524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 357/715] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:36.797981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.798539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.798981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.819329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:36.822436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:36.870197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc833e-855e-4048-a55f-d8fc58b37d9f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:36.932137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:36.938278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:36.938865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:36.939349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:36.959482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 358/716] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 03:28:36.961995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:36.963480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:36.982797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:36.983703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:36.984855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:36.984855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:36.984855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:36.984855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:36.984855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 359/717] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:36.990200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.002838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.019323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.172914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7e2d8-e0d7-4b51-9477-25857b9387ff None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.202429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.233972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.234599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.234880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.235153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.239641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:37.239976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.241624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.261395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 359/718] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:37.268812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.332875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284994-4e4c-46b3-adbc-42b192b606fb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.403061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.404112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.404540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.404956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.429270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:37.437292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:37.438405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:37.439430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:37.442793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 360/719] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 441 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:37.454931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.455834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd25e3-4678-400c-8165-83230316f922 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.491677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.492472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.492750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.493021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.499951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.501378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:37.520413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:37.521359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:37.522267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:37.528097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 360/720] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:37.534594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.591183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.603583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.654857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c4f99f-df79-4f90-9e7e-920a9197db48 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.719673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9d8b6-8ee9-40a5-a242-c2b86efa8e71 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.727376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.728081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.728365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.728641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.729400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:37.729754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.731178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.748616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 361/721] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:37.753648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.789927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.790652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.790941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.791219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.792023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:37.792332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.793763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.813346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 361/722] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:37.817421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:37.893393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b54409b-ad3a-4aa9-aefa-76d6fd533e7a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.916876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.923977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5dc08-48f7-47fb-9f18-4a0845458b18 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:37.933877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:37.942236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.943031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.943312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.943586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.958779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.959837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:37.960325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.960739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.960986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.961237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.962218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:37.962521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:37.963980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cca1cb-9496-4b11-9819-c0b9a71c4687 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:37.969908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 362/723] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:37.971286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950b02-d748-414a-8725-8b6aa880aae3 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.971572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950b02-d748-414a-8725-8b6aa880aae3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.971848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90950b02-d748-414a-8725-8b6aa880aae3 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:37.977375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 363/724] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:37.979401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:37.979694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:37.979979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:38.004622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:38.005663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:38.006686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:38.006686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:38.006686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:38.006686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:38.016421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 362/725] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:38.018266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.019614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:38.021816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:38.169882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 364/726] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:38.189473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.211973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87770cdf-51ec-4da1-9f79-fa75dd80e5b4 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.249576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.250647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.251125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.251683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.252713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:38.253225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.254963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68980abd-3a0e-44ee-986f-20124bcc1aa7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.272278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 363/727] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:38.273983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498de87-6671-4a50-bdd1-8e4c0baa1d16 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.274526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498de87-6671-4a50-bdd1-8e4c0baa1d16 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.275056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498de87-6671-4a50-bdd1-8e4c0baa1d16 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.277108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 364/728] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:38.278142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498de87-6671-4a50-bdd1-8e4c0baa1d16 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.287325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.301652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a20d1-a3a7-4191-bc1b-173a8724ecee None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.327190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.338587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.339391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.339674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.339956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.350928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a4928dbb-306d-47af-966d-3c39d9d630fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:38.358546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:38.359478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:38.360713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 365/729] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:38.366811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.367112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.367394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.385892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:38.387198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:38.396881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498de87-6671-4a50-bdd1-8e4c0baa1d16 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.440582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.441701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.442040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.442320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.451581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.453467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.466179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 366/730] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:38.467135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:38.480127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:38.481057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:38.481983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:38.483330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 365/731] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:38.489479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.566883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.585461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509332c-f0d7-4e55-b732-24a17eeeeb35 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.595751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c78c-2acc-4431-8527-29bf138ed6dd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.597296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.622004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.622525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.622820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.623106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.623865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:38.624286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.625889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.635031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.635697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.635981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.636383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.636800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 367/732] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:38.637783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.642238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:38.642238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.643448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.662926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 366/733] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:38.663838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.744652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54c77a-7bbd-475f-b83a-5c72be8fe777 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.768501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d6ed2-6dde-45d8-b974-ba321c97e2b0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:38.781531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.782567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.783059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.783536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.784469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.786125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.805331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:38.806155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:38.806446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:38.806717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:38.818278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:38.819718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:38.838257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:38.839287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 367/734] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:38.840201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:38.860253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.869351 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:38.873997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 368/735] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:28:38 2022] POST /identity/v3/services => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:38.875560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.028202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c322bb8-28d6-472c-8512-01d3151b92a7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.074094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.075202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.075635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.076338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.077805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:39.078962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.080512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.094706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 369/736] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:39.101370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.109299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c5d40-cad4-4758-8f25-fa091cf34482 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.151514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.153247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.153633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.154045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.183771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.239102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66192f-b8aa-4fdb-9305-48e05b7d8dad None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.250949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.252510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690f9a4-9e55-4d5a-a063-1d96475d1388 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.268291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.290844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.291647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.291938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.292215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.301502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.303193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-afe1f463-21c9-4292-897e-c98455e74249 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:39.319147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:39.320111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:39.321032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 370/737] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:39.326136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788f4a-5cbe-4f70-8aa2-48da34f2568d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.326414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788f4a-5cbe-4f70-8aa2-48da34f2568d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.326705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f788f4a-5cbe-4f70-8aa2-48da34f2568d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.328482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 371/738] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:39.329918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f788f4a-5cbe-4f70-8aa2-48da34f2568d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.371538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 368/739] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 03:28:39.373303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.373889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.374234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.392124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:39.393426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:39.463219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f788f4a-5cbe-4f70-8aa2-48da34f2568d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.469617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 369/740] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 03:28:39.470556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.485430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.511232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.512239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.512767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.513228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.514299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:39.515370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.517490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.518853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.543775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 372/741] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:39.550025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.590455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618ecea-dcfe-4dc6-a88e-d75f1376647e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.628619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.629419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.629705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.630060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.641043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.642460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:39.662057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:39.663664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 370/742] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:39.664531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.686685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed959c-8f0a-482a-a4fc-002010350991 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.733590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.734692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.735198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.735483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.736246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.737665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.773207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.780043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22315d5-efa6-47b8-b6cb-522a13524e6d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:39.812294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 373/743] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:28:39 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:39.813883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:39.821281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:39.822081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:39.822371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:39.822704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:39.866859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:39.906668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:39.908338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:39.953827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39bbbb-cb1e-4f40-b16e-7d437824bc03 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.010705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.011416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.011707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.011990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.012738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:40.013053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.014573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.052767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 374/744] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:40.058819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.062988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.079509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 371/745] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:28:40.086663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.196510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.203092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32094ff2-54dd-4e1a-b6ed-4eb2998978b4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.206049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629c439-865b-402e-a4e9-01e088b2b5cc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.239442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.240139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.240477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.240709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.245443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.246515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.247021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.247501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.248780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.250286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.259427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.261050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-6d4e642c-8fd9-433c-b991-4b9fb3def0df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:40.273407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:40.274548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:40.275727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 375/746] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:40.276232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736ee6-20ce-4a67-b949-b24408911f7d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.276399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736ee6-20ce-4a67-b949-b24408911f7d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.276681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e736ee6-20ce-4a67-b949-b24408911f7d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.281886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 376/747] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:40.283238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e736ee6-20ce-4a67-b949-b24408911f7d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d4528b66-f9e8-4814-9fc3-18040613babe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:40.288773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:40.289810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:40.290746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:40.290746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:40.290746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:40.290746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:40.295736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 372/748] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:40.295736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.295736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.295736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.313139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:40.314932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:40.360025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.401936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 373/749] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:40.403146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.436672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e736ee6-20ce-4a67-b949-b24408911f7d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.472863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.473360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.473644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.473947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.474733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:40.475038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.476520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.489469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 377/750] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:40.490414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.506657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.526664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f9e87-74e7-4bfe-9182-163a58acfcf2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.563030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.563828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.564853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.564853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.565298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:40.565675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.567824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.585202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 374/751] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:40.586229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.597170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8976d-a418-4e9d-8d33-f25050f88bdf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.621189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.634755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.635906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.636397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.636896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.648129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:40.656079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:40.656988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:40.657815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:40.665739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 378/752] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:40.665739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.700112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705059da-5a65-42e8-84ba-d9a9d78f90d2 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.736656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.737322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.737564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.738375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.739227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:40.739556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.740968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.747364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 375/753] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/role_assignments?user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:40.748442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.754585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.784130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a5d02e-795d-4125-bf35-d52f4b55e734 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.824991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.826830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.827314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.827859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.836309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.838275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:40.854296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:40.855243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:40.856113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:40.857356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:40.859948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 379/754] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:40.861051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec670-34b8-44a5-8f11-e4edb486c942 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:40.868343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:40.905740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:40.911055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:40.919550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 376/755] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:40.925255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.044853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc6e18-e54b-40d6-b2ca-b355af70f84c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.071427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061d95-411c-4707-9585-d3d6e1e9e398 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.086445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.087430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.088005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.088495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.089579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:41.090116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.091766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.099787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.105934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 380/756] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:41.117892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.130506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.131312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.131598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.131877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.144317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.145777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:41.165631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:41.166701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:41.167585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:41.167585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:41.167585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:41.167585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:41.167585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 377/757] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:41.173349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.198510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.285980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc4577-9efc-46a1-ad8d-c6e5e05d6d3c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.321713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.322423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.322712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.323106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.323868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:41.324448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.325755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.334467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fa7c-ca60-4dcf-8d65-4ba99f4be09c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.339192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 378/758] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:41.344701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.371585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.372603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.373091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.373560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.374820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=596a616025ee4112af72d799216c2fcf) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:41.375334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.377061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadc6a1-f316-412f-942c-591aef672abd None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.384032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 381/759] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/role_assignments?user.id=596a616025ee4112af72d799216c2fcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:41.390564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16843-103d-42cc-a8a8-5911ddfe9036 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.391145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16843-103d-42cc-a8a8-5911ddfe9036 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.391618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad16843-103d-42cc-a8a8-5911ddfe9036 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.393614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 382/760] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:41.399698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.400388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.400861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.434295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.435415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:41.436861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:41.469881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496929-9723-4279-bb99-16b9165815b3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.501048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.501880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.502176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.502456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.511803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.514168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:41.529167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:41.530386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:41.531516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:41.533560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 379/761] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:41.546128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.551476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.576591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 383/762] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:41.618942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.654526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766fe7f-41b3-4384-aeaf-65c191eb9cc6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.694285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.695393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.695903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.696382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.697524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:41.698178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.699814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.723341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 380/763] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:41.723942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.729619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.763315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ea06-47fe-4555-ba56-f770badd92a4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.799719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.800254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.800600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.800873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.801569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.802941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:41.814946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:41.815898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:41.816767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 384/764] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:41.827102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.848407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa764c3-b921-4a93-8646-52407a87ea83 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.882330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:41.887179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:41.888279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:41.888768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:41.889247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:41.901671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:41.903512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:41.922822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:41.923776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:41.924654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:41.924654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:41.924654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:41.924654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:41.927105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 381/765] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:41.931051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de87be0-8fc3-4606-bd3e-f42ce6d10126 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:41.933314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:41.986222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.009215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.010041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.010489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.010861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.011649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:42.014639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.016024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.031972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.037439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.081438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d346f-63c1-4765-aec3-dfb345556c3a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.118722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.119398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.119687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.119968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.120811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:42.121376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.122782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.136445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 382/767] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.141809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.242613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872188b-89b5-46a6-92c7-70d30aa91107 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.252442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.256849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70522-d07c-4f4b-a02b-a87aa4988b87 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.264415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.288718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.290348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.290811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.291518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.292724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:42.293643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.295718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5c5ad-b0c8-4ed4-b03e-f9b1935e871b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.299036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.300963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.301251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.301531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.308404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 386/768] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.308404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec7e-46b9-4a8d-8184-1d73acd6c5c0 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.308404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec7e-46b9-4a8d-8184-1d73acd6c5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.308404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8591ec7e-46b9-4a8d-8184-1d73acd6c5c0 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.312530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 387/769] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:42.313249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ec7e-46b9-4a8d-8184-1d73acd6c5c0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.314969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.317232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-321cd658-08f3-474c-a5f9-c2819d41b6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:42.332574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:42.333474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:42.334805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 383/770] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:42.339701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.339997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.340273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.357533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:42.358817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:42.437873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 384/771] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:42.437873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.459284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8591ec7e-46b9-4a8d-8184-1d73acd6c5c0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.505248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.506601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.507490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.508268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.509527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] RBAC: Adding query filter params (interface=public, service_id=4b5cd979efd3421aaa20eb9140de2e60, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:42.510458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.512328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.528683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 388/772] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/endpoints?service_id=4b5cd979efd3421aaa20eb9140de2e60&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.530276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.544058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.553650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dfd8b-780d-4b6c-9d1b-1930324a7387 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.589561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.590332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.590691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.591048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.591894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:42.592190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.592295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.594163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.612804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 385/773] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.613885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.663444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ce6f0-614c-4aed-bcff-2ec14bb5e25a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.706079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.707423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.707707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.708001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] PATH_INFO: `/v3/services/network` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.708829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.710386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:42.723318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:42.724303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:42.725551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 389/774] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:42.726354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.731041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462b289-2b11-4285-ad48-b8ea51268bb6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.770478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.771728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.772237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.772769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.773683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.775258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.786511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 386/775] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:42.787897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:42.831471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.853759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbacb79-88d7-4234-866b-d18b10e112dc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:42.862420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:42.895660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:42.896562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:42.896845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:42.897121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:42.901948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=99eac0e91e884f4c8e1c93f7f66d43a5, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:42.901948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:42.988608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 390/776] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:42 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:42.990114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15330f-7d66-4905-953a-811fc3f9a2a9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.036898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.038114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.038600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.039072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.040117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] RBAC: Adding query filter params (name=network) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:43.040630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.042353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1109c1-b3d6-466b-91a5-08d0db5e029b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.053125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 387/777] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:43.055030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.206042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391024-0135-4d0e-9760-8943a3395921 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.207208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391024-0135-4d0e-9760-8943a3395921 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.207485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3391024-0135-4d0e-9760-8943a3395921 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.209080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 388/778] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:43.214733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.215349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.219327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.228241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c3c74-d71a-47c7-b6eb-752e38158423 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:43.237498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:43.267967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.268639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.268924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.269234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.269974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] RBAC: Adding query filter params (type=network) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:43.270287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.271652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.277042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 391/779] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:43.282943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.315831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:43.320433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 389/780] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:43.343738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.355186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:43.387789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18674749-4d7a-4c7f-84fb-54fd2a7d88bf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.422847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.423514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.423800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.424082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.424946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] RBAC: Adding query filter params (interface=public, service_id=04b2e269ad05437fa3559dab4de55fff, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:43.425265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.427230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.432977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 392/781] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/endpoints?service_id=04b2e269ad05437fa3559dab4de55fff&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:43.439015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.455297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2228a-323d-4698-8e3b-66db3247f3c5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.493161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.494304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.494805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.495290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.506964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:43.515176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:43.516088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:43.516904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:43.520264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 390/782] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:43.526226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.554234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:43.564390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97be4f-441c-428e-bfc8-1b919a698ddf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.598291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:43.635674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b8570-761d-4847-9229-6a4ce3ee7294 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.646659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.647264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.647552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.647832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.648531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.650001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.656775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 393/783] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:43.675246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.676338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.676837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.677331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.678358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:43.678863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.680463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.690259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 391/784] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:43.697077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:43.860797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66fae5-32bb-4134-8c58-d0ac1510c5fc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:43.911032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:43.911829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:43.912111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:43.912384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:43.923361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:43.924820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:43.942610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:43.943563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:43.944438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:43.944438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:43.944438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:43.944438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:43.944438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 394/785] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:43.950674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.070247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73233d-f9d5-4932-a040-4e8302ec0543 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.099914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:44.106370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.107031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.107373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.107655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.118891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:44.118891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:44.118891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8f147d-8b0d-4290-9e52-511ac59401c2 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:44.123528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 392/786] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:44.129294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.136892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff91a4-c017-4760-aa8d-adb3f8bd20c2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.137252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff91a4-c017-4760-aa8d-adb3f8bd20c2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.137601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff91a4-c017-4760-aa8d-adb3f8bd20c2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.139289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 393/787] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:44.144955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.145334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.145675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.158137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:44.163052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:44.164248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:44.234842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 394/788] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:44.258820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.346472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64a967-5088-4d4b-87bd-110dd9264435 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.365607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31585db3-8c2c-45b6-94c2-32b7b08451b3 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.399978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:44.403310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.404108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.404446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.404728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.415521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:44.419291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.420114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.420401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.420673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:44.423387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:44.424284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:44.425538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 395/789] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:44.430706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.442807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:44.444287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:44.463486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:44.465817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:44.468158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 395/790] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:44.478815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.543489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d182c6b-944c-4e3d-b28c-9aa84a4bbee3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.580083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.580850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.581130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.581498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.582332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:44.582640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:44.584108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:44.593001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 396/791] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:44.598458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.638876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:44.645566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:44.703455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e38484-cd16-490e-adb6-f9dae862f440 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.710847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5b60a-326d-439e-9aae-b2252854e878 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:44.752385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.753173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.753591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.754374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.775823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:44.777262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:44.778823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:44.779494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:44.779774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:44.780045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:44.780877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:44.781183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:44.782657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:44.817931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:44.818872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:44.819739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:44.819739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:44.819739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:44.819739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:44.826209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 396/792] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:44.827115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.828101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 397/793] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:44.838576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:44.999649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.007208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4fc3d-d9e2-439b-b405-82420db3db85 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.033873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58419950-9e6c-49c8-a686-15626b41f801 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.072395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.073108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.073395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.073667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.074414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:45.074719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.076080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.093594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.100508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 398/794] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:45.106240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.109059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.109884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.110164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.110555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.123881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.125784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:45.145666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:45.146589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:45.147897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:45.147897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:45.147897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:45.147897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:45.147897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 397/795] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:45.152889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.278705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96a430-5c12-4a95-a605-4eec3c7ed404 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.314263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.315110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.315396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.315670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.334825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0c128-2cbc-418b-934e-32f369494d0e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.336971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.338427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:45.368114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:45.369106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:45.370086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:45.377694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 399/796] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:45.379224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.406071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.406744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.407024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.407298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.408027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:45.408332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.409745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.414210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.440118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 398/797] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:45.449890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.512890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.519741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8622195-af62-4a7c-bf31-c6e394015a70 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.556716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.557302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.557582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.557867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.558703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:45.559019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.560415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c85c6-e916-48b4-b647-d5ea4a301690 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.571368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aecc46-efe4-4473-952f-e06814925cb2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.578517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 400/798] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:45.579857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294fe1-5c4e-4abf-86bd-ed93958f01e7 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.580141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294fe1-5c4e-4abf-86bd-ed93958f01e7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.580416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b294fe1-5c4e-4abf-86bd-ed93958f01e7 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.582383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 401/799] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:45.583274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19c5e-9849-4e88-a046-ecf0dba12f94 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.583637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19c5e-9849-4e88-a046-ecf0dba12f94 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.583911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19c5e-9849-4e88-a046-ecf0dba12f94 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.585245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 402/800] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:45.589971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19c5e-9849-4e88-a046-ecf0dba12f94 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.615076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.615874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.616162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.616448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.623563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.625022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d792ce23-70a4-49c8-93f2-26971d40fe5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:45.640802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:45.641921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:45.643064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 399/801] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:45.643556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc832-9c25-403c-b486-ed5c091c7a16 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.643792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc832-9c25-403c-b486-ed5c091c7a16 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.644093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dc832-9c25-403c-b486-ed5c091c7a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.661198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-979dc832-9c25-403c-b486-ed5c091c7a16 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:45.662416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-979dc832-9c25-403c-b486-ed5c091c7a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:45.669470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.702052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19c5e-9849-4e88-a046-ecf0dba12f94 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.731428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 400/802] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:45.732788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.733146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.733487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.754468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:45.755212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.756227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:45.756635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.756979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.757258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.771460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.772891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.783802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:45.793125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:45.799482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 403/803] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:45.801089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.838723 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 401/804] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:45.839382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.910664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec92b31-12f0-41d0-bd09-8cf6bde54b4c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.937392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:45.943641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7267f-c36f-4f8e-8c68-3eee703474a5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:45.948710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.949375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.949664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.950013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.965909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:45.965909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.965909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:45.970954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 404/805] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:45.970954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:45.988676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:45.989483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:45.989763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:45.990065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:45.990720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:45.992387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:46.008329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:46.009275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.015544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 402/806] 10.222.0.42 () {56 vars in 1129 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:46.016390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.042442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.080620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae96e2b2-793b-4438-9ba5-33abc98b5d8c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.117951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0dc9b7-7f97-46e1-9ff1-ff0e5ff59de1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.118847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.119515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.119801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.120078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.120802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:46.121116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.122532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.138933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 405/807] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:46.138933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.158859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.160132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.160574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.160974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.176192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:46.184117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:46.187955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:46.188838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 403/808] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:46.195034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.243660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b191d-aaea-4586-815f-6df54bc3b9b4 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.277618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.278757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.278888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.279036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.279316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/5cb3aeb090624fbc9ed64c7bb2ca4d0d/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.293155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c19b42-cb4c-48ac-992d-85f96497344c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.293697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=5cb3aeb090624fbc9ed64c7bb2ca4d0d, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.295181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289b827-9f21-4eeb-8882-7e285c5ba484 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.326959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.327740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.328040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.328444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.329288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:46.329604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.330992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.335505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 404/809] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:46.336336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.368784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 406/810] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:46 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/5cb3aeb090624fbc9ed64c7bb2ca4d0d/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:46.370170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bb4-34d5-44fa-a5e1-edb3f139d233 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.370461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bb4-34d5-44fa-a5e1-edb3f139d233 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.370735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a07bb4-34d5-44fa-a5e1-edb3f139d233 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.372355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 407/811] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:46.373187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07bb4-34d5-44fa-a5e1-edb3f139d233 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.453312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aafd73-bb6e-4ee8-a334-4dba5ac7b173 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.483936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.493084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a07bb4-34d5-44fa-a5e1-edb3f139d233 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.496394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.496394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.496394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.496394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.504810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.506294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:46.523076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:46.524013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.524894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 405/812] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:46.525828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.536643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.541657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.541657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.541657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.541657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:46.541657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.542050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.542129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fad7d-f557-46eb-a859-0f9dc9eb7c72 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.549615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 408/813] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:46.550974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.551269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.551549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.569337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:46.570539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:46.633959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef08104-2f3d-490f-80a1-e4e3036239f3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.645874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 409/814] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:46.645874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.675292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.675962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.676246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.676521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.677347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:46.677800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.679154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.685089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 406/815] 10.222.0.42 () {56 vars in 1124 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:46.690294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.734565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.750444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33625201-0f3b-4b4f-a877-1bbba6ed3b0d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.773783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:46.785722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.786414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.786696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.786969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.787755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:46.788058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.789534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.806101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 410/816] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:46.806101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.806375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e946314-cdd9-40b4-b22e-2bd5ee845382 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.843189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.843987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.844273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.844552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.855148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.856576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:46.874658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:46.875563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 407/817] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:46.876997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.924348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c89f05-4e0a-4213-a89d-b9ec491c6970 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:46.960614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:46.961785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:46.962010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:46.962279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] PATH_INFO: `/v3/services/network` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:46.962922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:46.964276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:46.978480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:46.979485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 03:28:46.980307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:46.982367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 411/818] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:46 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:46.983128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:46.994890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95781ef-5816-47db-a86a-c11cbdcc3a59 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.000067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.023877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.032152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.032810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.033091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.033365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.034130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.035514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.091228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5356481-e238-4041-abbe-12c782cd2a0f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.127541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.128455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.128737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.129021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/596a616025ee4112af72d799216c2fcf/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.131068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=596a616025ee4112af72d799216c2fcf, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.132504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.135369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 408/819] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:28:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:47.136116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.213449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 412/820] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:28:46 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/596a616025ee4112af72d799216c2fcf/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:28:47.213449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.307760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c934909-9040-4ae1-828f-b4b631707481 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.338651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.360836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.361539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.361828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.362142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.362982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:47.363307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.364736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.383322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 409/821] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:47.385367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1b4cf-aaba-412e-8224-ebaf75c090d1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.390075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.429621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.429621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.429621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.430060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.430595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] RBAC: Adding query filter params (name=network) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:47.430908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.432271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.437461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 413/822] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:47.444280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.447789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.535367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47a64e-5518-44a6-b067-ab322ecc13f1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.581118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d722271c-fc57-4bff-9025-b55ed59de671 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.590903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.591713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.591997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.592272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.602312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.603791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:47.638035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:47.639028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:28:47.639948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:47.645397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 410/823] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:47.652558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.654466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.657176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.657467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.657746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.658491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] RBAC: Adding query filter params (type=network) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:47.658802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.660219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.666686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.677178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 414/824] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:47.688978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.775133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b5316-e2e8-4fa3-814a-9dae2c5781d6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:47.778151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:47.814540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:47.815136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:47.815424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:47.815701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:47.817267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:47.817584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:47.819343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:47.839396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 411/825] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:47.845134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:47.958097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8518-257f-4204-a08e-ed1404f9ce0a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.010006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.010680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.010968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.011244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.013922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b921d-0e81-4040-9965-f47ba7a0ff1c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.067297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:48.078881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.079899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.080353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.085177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.085177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:48.085177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:48.135076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:48.136624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:48.170992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 415/826] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:28:47 2022] POST /identity/v3/endpoints => generated 327 bytes in 482 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:28:48.249968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 412/827] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:28:48.256211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:48.350217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:48.405906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2d66-3098-4ea8-919e-a4814f1715b9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.443322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.444512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.445003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.445489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.456565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:48.458849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-63ca915a-2db9-4df8-a7ae-027c22de380c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:48.478914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:48.479865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:48.480763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:48.480763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:48.480763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:48.480763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:48.483107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 416/828] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:48.489410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:48.549828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:48.603150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3457dc-b87a-47da-8db0-3dcdaeaa5636 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.635282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0c3c-4c55-4626-bfe9-06f36684e4eb None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.635932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0c3c-4c55-4626-bfe9-06f36684e4eb None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.636415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0c3c-4c55-4626-bfe9-06f36684e4eb None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.638424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 417/829] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:48.643689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.644250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.644729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.649017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.649704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.650016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.650295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.651095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:48.651331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:48.653138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:48.665779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:48.667322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:48.667526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 413/830] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:48.676417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:48.767287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 418/831] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 24 03:28:48.792239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ede31a-fbab-4187-9ec6-ed0f67413f25 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.797878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:48.809952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:48.829525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.830541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.830830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.831110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.837035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:48.840344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:48.842008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:48.857057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:48.857983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:48.859062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:48.861152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 414/832] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:48.868441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:48.921564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2718d-ef53-4fa6-97f7-6adde9dbac37 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.959060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:48.960092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:48.960326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:48.960611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:48.971902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:48.981601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:48.982734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:28:48.983559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:48.986549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5993f-f362-4337-bde9-841031905748 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:48.988325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 419/833] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:48.989346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.030450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.031499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.031990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.032466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.033458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:49.034005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.035814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.054554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 415/834] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:49.055965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.092582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.095478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.102886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c7f93-6737-4e51-8ed0-3712b9de8cea None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.141418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.142349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.142797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.143231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.144163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:49.144694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.146289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.161161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 420/835] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:28:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:49.162392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.168290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bf5fc-24b7-4a72-9fac-726f2efd6b2d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.212137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.213565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.213565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.213565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.214640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:49.215051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.216597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.230195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 416/836] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:49.292074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891c990-9bb3-487c-ab89-98a289d36489 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.332923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.334149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.334601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.335029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.348496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.350223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-288ba6e3-6711-4d39-b8db-2608237e0da9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:49.370351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:49.371450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:49.372336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:49.372336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:49.372336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:49.372336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:49.374267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 421/837] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:49.380079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.469928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e075-5308-444e-9986-4675efd8161f None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.470144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e075-5308-444e-9986-4675efd8161f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.470429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6159e075-5308-444e-9986-4675efd8161f None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.472072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 422/838] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:28:49.477605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473389-072f-4925-b659-e145398c2e60 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.477925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473389-072f-4925-b659-e145398c2e60 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.478214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473389-072f-4925-b659-e145398c2e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.491226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.492047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.494535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fcd29e-d4cb-4643-87de-5f06b39e638b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.499317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1e473389-072f-4925-b659-e145398c2e60 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:49.500523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1e473389-072f-4925-b659-e145398c2e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:49.531998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.533041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.533539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.534062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.535056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:49.535623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.537229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3be5b8-806a-414a-bdc5-47adb00f1646 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.550995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 417/839] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:49.552737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1a55-da03-46ba-b12b-508fe2c4a9a1 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.553141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1a55-da03-46ba-b12b-508fe2c4a9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.553531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb1a55-da03-46ba-b12b-508fe2c4a9a1 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.556188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 418/840] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:49.556965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb1a55-da03-46ba-b12b-508fe2c4a9a1 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.581225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 423/841] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:49.583116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.583405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.583681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.600434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:49.601642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:49.671710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 424/842] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:49.678047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.678129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb1a55-da03-46ba-b12b-508fe2c4a9a1 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.716023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.716840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.717129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.717409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.725000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:49.726431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:49.757428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.796269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b821108-061b-468e-b752-0a401c1d1917 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.835092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:49.835906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:49.836196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:49.836476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:49.848122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:49.855121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:49.856084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:49.857017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:49.857557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:49.860263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:28:49.862529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:49.863682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 419/843] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:49.863761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 425/844] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:49.863831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.864486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:49.885196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:49.965554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66c86-aa21-4643-948d-40d143e95549 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:49.981603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd8f9e-e6eb-4a4f-8c27-56422f60eb98 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.009412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.010114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.011382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.011798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.012080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.012902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.014921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.018140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.020052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.020052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.020052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.020259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.020547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.021957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:50.028228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:50.029168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:50.036067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 420/845] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:50.036884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.044407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 426/846] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:28:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:50.045292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.123333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.138797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9824c0-0d40-4001-bc12-ffb5230a937e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.154814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4082f7-a921-4c3f-bd57-383aab1fd3fb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.177088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.177956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.178249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.178521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.179268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.179578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.181030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.189507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 421/847] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:50.190420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.192762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.193425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.193713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.194095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.194731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.195049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.196610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.205998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 427/848] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:50.206865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.257946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.309300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee161b46-ba61-47e7-8551-edd03eaec0c7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.312181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876e83-3127-4063-9909-4c2758a54cd9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.345318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.346087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.346375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.346651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.347736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.348531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.348819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.349096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.360352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.361807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.366120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:50.380467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:50.381727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:50.382742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:50.382742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:50.382742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:50.382742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:50.382742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 428/849] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:50.383073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.428311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.429753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.487050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.491075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6bc3da-e9cf-471a-a9b1-6117e5747e30 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.529954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.530564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.530844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.531118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.531819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.532126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.533479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.540189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 422/850] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:28:50.540189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.542639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 429/851] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:50.546708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.602298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.666129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6e74a-c7d7-49f2-ad0f-eb2448a91ffa None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.677966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3280a-d870-4a8d-a476-c226177dcd68 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.711750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.712677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.713019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.713363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.724930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.725380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.725760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.726143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.726486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.727127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.727330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.727573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.729018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:50.745885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:50.746824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:50.747722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:50.747722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:50.747722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:50.747722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:50.747962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 423/852] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:50.748034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 430/853] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:50.748102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.755349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.777202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.870099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d045e-ce35-416c-8af3-371ceba96893 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.877938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bd473-fe65-403e-a190-70540170eff6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:50.888235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:50.911536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.912527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.912988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.913464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.914524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:50.915033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.916587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.922542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:50.923892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:50.924247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:50.924596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:50.931587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 431/854] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:50.936962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:50.938575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:50.940012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:50.955543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:50.956645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 03:28:50.958115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:50.961970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 424/855] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:50.963226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.039647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.071123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9841d76-b9b2-4927-a3ba-9ec1df0c00d7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.073470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1da82-df95-4d71-a7d1-7fe63d5c821c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.108947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.109673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.110003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.110357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.111243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:51.111553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.113098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.114029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.115010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.115303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.115586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.125323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.129621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.136594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 425/856] 10.222.0.42 () {56 vars in 1135 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:51.137983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:51.146267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:51.147111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:51.147988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 432/857] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:51.155441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.179949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.268566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6a1eb-c6c3-438d-864d-af66f57b64c8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.283878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6af054-5407-4b87-8fed-33d9e19f0f3e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.307127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.307855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.308209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.308832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.309545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:51.309963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.311477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.314976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.330987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 433/858] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:51.332334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.337540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.337540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.337780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.338092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.412537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.413929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.438472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.444533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdc018-193e-4d96-90e1-aef031eeb1c2 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.482132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.482792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.483072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.483343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.484169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:51.484464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.485885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd8141-8ed3-4726-8e92-e77be982b767 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 434/859] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/role_assignments?user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa48f-41d4-45c9-adde-6bda43dabcbd None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa48f-41d4-45c9-adde-6bda43dabcbd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fa48f-41d4-45c9-adde-6bda43dabcbd None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 435/860] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:51.501878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.502493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.502493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.529037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:51.531139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:51.537180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 426/861] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:28:51.543983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.612565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.634013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 436/862] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:51.659465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.668570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802468b-fa12-47a7-a5ad-36a116ef4754 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.704327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.715831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.719080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.719080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.719080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.732604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.735170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:51.761814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:51.762783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:51.763680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:51.763680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:51.763680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:51.763680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:51.763680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 427/863] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:51.769108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.799001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596ed62-591b-4e85-a15d-3c53c5432d30 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.836712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.837523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.837809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.838113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.838765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.840132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:51.852535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:51.854711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:51.855914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 437/864] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:51.862806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.892573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62293438-8e6d-4211-9a03-c1a1172ed4e5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:51.924154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:51.933692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:51.934579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:51.935175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:51.935603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:51.936919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:51.937656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:51.940086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:51.955489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 428/865] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:51.962802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:51.980690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579aa4-d686-467f-91de-6266cf2d90e6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:52.008590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:52.018817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:52.022056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.022056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.022056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.022056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:52.022056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:52.022762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:52.031837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 438/866] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:52.032854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:52.085258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4623b6-41d8-4fc7-bdff-aea28bb9c9f6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:52.122120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:52.123381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.123912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.124402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.132618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:52.134449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:52.142061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0cf53-6e07-4b06-a0c7-1599193cc11d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:52.150431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:52.151332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:52.152225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:52.154725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 429/867] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:52.160822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:52.165058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:52.186037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:52.186783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.187068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.187346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.188305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:52.188640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:52.190036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:52.202236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 439/868] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:28:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:52.281443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:52.289033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526c2ea-2841-426d-9921-69d0c679257f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:52.328660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:52.329721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.330226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.330700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.331827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:52.332337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:52.334061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4484c-37eb-4292-8ccc-527c0cce31f1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:52.352333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 430/869] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:52.354165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:52.461309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccc660-3b74-45a7-a888-fb4bf3278004 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:52.496478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:52.497131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.497413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.497685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.498539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=596a616025ee4112af72d799216c2fcf) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:52.498850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:52.500270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e189e6-0b8e-4cfe-ac26-eae9abd60e86 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:52.507140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 440/870] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:52 2022] GET /identity/v3/role_assignments?user.id=596a616025ee4112af72d799216c2fcf&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:52.739004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0154e8-3cf9-4794-8002-cf4bfb3f238b None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.739228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0154e8-3cf9-4794-8002-cf4bfb3f238b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.739481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0154e8-3cf9-4794-8002-cf4bfb3f238b None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.741226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 431/871] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:52.747282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54959e-40f5-447e-9c57-b885b555074d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:52.747576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54959e-40f5-447e-9c57-b885b555074d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:52.747859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54959e-40f5-447e-9c57-b885b555074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:52.766329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9a54959e-40f5-447e-9c57-b885b555074d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:52.767534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9a54959e-40f5-447e-9c57-b885b555074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:52.810757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:52.836080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 441/872] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:52.859392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0154e8-3cf9-4794-8002-cf4bfb3f238b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:52.968981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0154e8-3cf9-4794-8002-cf4bfb3f238b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:53.007091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:53.008023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:53.008500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:53.008989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:53.009966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:53.011522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6169ce5-160c-4195-bdf7-202332f98782 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:53.073257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 432/873] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:28:52 2022] POST /identity/v3/services => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:53.708190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3428-7ffb-4569-95ce-5da5abbad63c None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:53.708836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3428-7ffb-4569-95ce-5da5abbad63c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:53.708836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1b3428-7ffb-4569-95ce-5da5abbad63c None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:53.710417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 442/874] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:53.715595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:53.716003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:53.716191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:53.733703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:53.734925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:53.746418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:53.818163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 433/875] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:53.838133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3428-7ffb-4569-95ce-5da5abbad63c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:53.943351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1b3428-7ffb-4569-95ce-5da5abbad63c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:53.982705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:53.983826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:53.984303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:53.984787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:53.996630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:54.005607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:54.006570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:54.007775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 443/876] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:28:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:54.012990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.114664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd5846-09f8-4ee0-936d-fd2d5a1e8bb0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.150180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.150927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.151206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.151480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.152229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:54.152533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.153922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.162760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 434/877] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:54.168350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.209271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:54.277042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449636a2-04cd-4c5e-bd29-7a86baefb753 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.312010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.312809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.313088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.313362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.324206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.325775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-5dc5634b-a391-46c1-bb5e-bce623fc8ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:54.343354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:54.345400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:54.347609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:54.347609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:54.347609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:54.347609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:54.347609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 444/878] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:54.350465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.368801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:54.370470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754a2d-bba9-4f1f-9ee5-14c880ad7267 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.370762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754a2d-bba9-4f1f-9ee5-14c880ad7267 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.371036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc754a2d-bba9-4f1f-9ee5-14c880ad7267 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.372876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 445/879] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:54.380498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.382810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.382810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.398743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:54.400224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:54.471782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c0989-ee7d-4e1e-9c80-8dd383cd7cb1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.481012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 446/880] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:54.500713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.523101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.524111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.524601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.525102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.526082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:54.526596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.528216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.538287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:54.541788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 435/881] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:54.547240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.612400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:54.614159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593dad4-1e76-4d0c-a0fa-452675f9eaf5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.652903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00f3e8-198d-4b42-acf4-37914fd95267 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.653880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.654811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.655413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.655770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.656533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.657909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d3cd3-8531-4f8c-ba6d-fedb8da651bf None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.686805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.687609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.687891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.688167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.695696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.697141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c9f68280-73df-47b2-b583-400dfd519977 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:54.712455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:54.714830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 436/882] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28cae8-71ee-4123-a7c3-f0e5a48c2bd5 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.716190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28cae8-71ee-4123-a7c3-f0e5a48c2bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.716882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28cae8-71ee-4123-a7c3-f0e5a48c2bd5 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.716951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 437/883] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:54.720359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28cae8-71ee-4123-a7c3-f0e5a48c2bd5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.784078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 447/884] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:28:54 2022] POST /identity/v3/services => generated 269 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:28:54.784078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.784078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.784078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.809013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:54.810663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:54.837831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28cae8-71ee-4123-a7c3-f0e5a48c2bd5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:54.866110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:54.888448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:54.891952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:54.891952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:54.891952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:54.891952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:54.892624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:54.895646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:54.905881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 448/885] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:54.923682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 438/886] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:54.927034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.929038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:54.939883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.060571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b0b1-6dd7-4958-b706-4d9ada712271 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.065794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8296fb-832f-48df-8009-f102042e2474 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.106370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.107333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.107723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.108098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.108859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.110163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.110485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.111348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.111777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.112242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:55.126830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:55.127873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:28:55.129277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.133929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 449/887] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:55.135759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.176404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.201803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.203303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45757852-e8b8-4c25-9c77-87462fec79dc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.219229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.249481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba2f26-a44d-4b8a-ba0e-6dac39ec9228 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.283408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.284574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.285458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.285737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.286480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:55.286785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.288154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ebcd5c-c53c-4909-ba93-285acc8eb5be None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.298296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 450/888] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:55.298296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813a01-b52c-47a3-a412-52fa2f3d0e6c None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.298296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813a01-b52c-47a3-a412-52fa2f3d0e6c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.298296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d813a01-b52c-47a3-a412-52fa2f3d0e6c None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.298296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 451/889] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:55.299207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813a01-b52c-47a3-a412-52fa2f3d0e6c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.322355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 439/890] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:28:54 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:28:55.322355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.322355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.322355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.336187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:55.337364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:55.413947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 440/891] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:55.413947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.419122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d813a01-b52c-47a3-a412-52fa2f3d0e6c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.425551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.455831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.457222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.457511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.457791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.458633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:55.458987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.460359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.462487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.465589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 452/892] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:55.470904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.539183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bf18d-c687-4419-96a5-ac2724fd80f4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.589977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.590981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.591381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.591664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.615776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.618346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.628058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b7795-9f59-43e1-8a73-25cc55a6f087 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:55.639347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:55.640256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:55.641131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:55.641131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:55.641131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:55.641131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:55.645275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 441/893] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:55.646477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.679081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.679935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.680228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.680505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.681161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.682579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:55.696036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:55.697146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:55.698037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:55.702763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 453/894] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:55.703996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.726443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.773396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1de5dc-789c-4d3e-bb72-a35b98f8ecf0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.777229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:55.816189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.817530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.818338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.819031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.819911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:55.820389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.821185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da0a44-6340-43f4-b611-05e5eb432987 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:55.822535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.840295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 442/895] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:55.848239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.864744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:55.866448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:55.867270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:55.867966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:55.869157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:55.869650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:55.871602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:55.879380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 454/896] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:55.884943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:55.982431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9986-33ee-42d6-a3a4-2f4e25eba0d2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.009885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:56.018791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.030944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.030944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.030944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.031185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f75a2-7f14-4344-b9b0-ee881c475440 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.031272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.031272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:28:56.044745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:56.045630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:28:56.046545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:56.049140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 443/897] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:56.055842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:56.056615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:56.066128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.068951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.068951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.068951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.068951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:56.069216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.070547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.077062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 455/898] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:56.083046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:56.185972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55e678-4b8c-400a-8776-d7020b83d464 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.193010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd4d78-8ed2-4304-8f22-26c583e41d2b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.224650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.225348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.225641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.225903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.226760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:56.227073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.228758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.238013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.239453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.240225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.240703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.241694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] RBAC: Adding query filter params (interface=public, service_id=c6948ca0293243c8b2e8745b916ab905, region_id=RegionOne) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:56.242480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.242599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 444/899] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:28:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:56.244182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.247972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:56.258192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 456/900] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:28:56 2022] GET /identity/v3/endpoints?service_id=c6948ca0293243c8b2e8745b916ab905&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:56.262805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:56.303201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:56.322358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:56.366569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcee648-d7ad-4167-8d10-25a7092cbbb7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.370688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daeafd6-2ae4-4232-85c5-32faf8e4acfd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:56.403038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.403685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.403966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.404240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.405120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] RBAC: Adding query filter params (role.id=891f64d5451f4aad9c9d7f925fe4014f, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:56.405359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.406798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be519950-a951-40ad-aa99-90e17f50027e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.409680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:56.410625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.411115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.411595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.412532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:56.412773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 445/901] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:28:56 2022] GET /identity/v3/role_assignments?user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=891f64d5451f4aad9c9d7f925fe4014f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:56.414547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0daaf00-f910-4a9d-b37c-458b50ff7922 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:56.430146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 457/902] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:28:56 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:28:56.936565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bcbd8-73ca-46cf-87db-aae9ec5d5e11 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.937622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bcbd8-73ca-46cf-87db-aae9ec5d5e11 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.938146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bcbd8-73ca-46cf-87db-aae9ec5d5e11 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.939969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 446/903] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:56.945392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:56.946204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:56.946681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:56.964025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:56.965523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:57.046897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 458/904] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:57.069724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bcbd8-73ca-46cf-87db-aae9ec5d5e11 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.178894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bcbd8-73ca-46cf-87db-aae9ec5d5e11 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.181743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:57.215782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.216893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.217370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.217837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.218746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.226331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:57.233792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:57.234705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:28:57.235908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:57.238545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 447/905] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 03:28:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:57.244906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.297252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:57.349342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a565fc-4d95-4de6-badb-a795a754b09b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.388897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.389573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.389879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.390221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.390968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:57.391333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.392715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360fc3b-0067-4b0a-900d-77566e40b4dd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.398777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 459/906] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:28:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:57.404229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.510389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea62f88-15da-4fb2-95ba-f2a8435923e8 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.537754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7baa2-315a-42a3-a403-b0d0226cf9a5 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.538085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7baa2-315a-42a3-a403-b0d0226cf9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.538353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b7baa2-315a-42a3-a403-b0d0226cf9a5 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.539944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 460/907] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:57.545291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.545581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.545880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.548574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.549530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.550031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.550344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.551091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:57.551539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.553059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.559230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 448/908] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:28:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:57.564954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.565884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:57.567309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:57.603749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:57.670495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 461/909] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:57.685108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc97126-6ceb-4367-8f7f-908182458b18 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.694009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.732434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.733502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.734034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.734511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.735488 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] RBAC: Adding query filter params (interface=public, service_id=a0760842ec47471481ca957100f02d33, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:57.735994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.738246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.744234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:57.747054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 449/910] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:28:57 2022] GET /identity/v3/endpoints?service_id=a0760842ec47471481ca957100f02d33&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:57.752227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:57.822999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749de28-c976-4d83-ae78-2687cac7ce92 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.853557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:57.859743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5db12a-17e8-4cdd-a8ed-3a209547f16a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:57.869495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.870753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.871482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.871952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.873018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.875237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40982117-10c3-49b2-a69f-97a94192eb06 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.895264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:57.896040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:57.896382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:57.896722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:57.897467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:57.898969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24edff9-6c95-432d-9e9a-c6e8ae54bba5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:57.905076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 450/911] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:28:57 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:28:57.953449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 462/912] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:28:57 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:28:58.497068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85eee4-2ea9-4fd2-b512-18b893fdf9ac None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.497591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85eee4-2ea9-4fd2-b512-18b893fdf9ac None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.497591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85eee4-2ea9-4fd2-b512-18b893fdf9ac None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.499290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 451/913] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:58.504452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.504747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.505026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.522078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:58.523274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:58.560828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5c2e-fdf1-47d0-8e1d-078ec749f8fa None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.561127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5c2e-fdf1-47d0-8e1d-078ec749f8fa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.561412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f5c2e-fdf1-47d0-8e1d-078ec749f8fa None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.565877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 452/914] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:28:58.568707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.568987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.569268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.587114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:28:58.588309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:28:58.607828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 463/915] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:28:58.631106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:58.668047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:58.678324 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 453/916] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:28:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:28:58.697522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:58.753365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b64ff8-68bc-4f7b-9de0-85b15b40c7bd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:58.798411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:58.799414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:58.800661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.800948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.801227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.802189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:58.803732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:58.810027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7e8f3c-4169-4e8e-b014-d7ce94efd285 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:58.818297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:58.819328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:58.822803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 464/917] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:58.827183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:58.863748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:58.865023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.865536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.866765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.880161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:28:58.890750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:58.891689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:28:58.892504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:58.895855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 454/918] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:28:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:58.902350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:58.934867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:58.942474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903604-e83d-4939-aefc-eae3033b2ce0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:58.982439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:58.983182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:58.983453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:58.983745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:58.984490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:58.984807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:58.986214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:58.996359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 465/919] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:28:58.997705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.030932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ce14f-cef8-488c-9521-b40302601a4e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.072616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.073676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.074199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.074682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.075641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:59.076146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.077721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.087331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 455/920] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:28:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:59.093372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.116401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:59.125117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97851-d312-4ff2-9fd6-fe067fe4ab30 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.172650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.173970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.174755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.175700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.176887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:59.177649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.179964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.187192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 466/921] 10.222.0.42 () {56 vars in 1114 bytes} [Fri Jun 24 03:28:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:59.193140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.218848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:59.225670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e9cf-5313-4946-bfbd-c3995f1facdf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.261977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.263132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.263614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.264090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.276034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.277770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:28:59.295528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:59.296373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:59.297341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:28:59.297341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:28:59.297341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:28:59.297341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:28:59.298747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60cbfd-6562-4b90-8c20-e96de8e264fd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.299818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 456/922] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:28:59.305811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.346056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.346972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.347284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.347563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.348727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.350719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.386761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:59.426420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a87380-aeab-4a73-a5d7-3fd36bb7f7e4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.429921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 467/923] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:28:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:28:59.480910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.482052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.482596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.483134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.484099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:59.484656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.486369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.506095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 457/924] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:59.509916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.602969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:59.626008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8e05ab-c53a-45b2-a010-9a66ddd7e244 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.661804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.662649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.662933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.663212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.670894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.672385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:28:59.688915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:28:59.690235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:28:59.692107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:28:59.695815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 468/925] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:28:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:28:59.700943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.807294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95dc77-a88e-43e4-8cbe-8f3f03805d73 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.829052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:28:59.844225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:28:59.844911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.845194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.845473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.846395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:28:59.846681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:28:59.848979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1791aa4-94cd-4f76-bb7e-bdca5a6f7ace None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:28:59.868569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 458/926] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:28:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:28:59.874297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:28:59.984946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664ad79-d192-4aef-9fe7-3e98d73eae3e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:28:59.995492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46d99-65fe-4ef1-8375-fadb11dcd599 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:28:59.995781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46d99-65fe-4ef1-8375-fadb11dcd599 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:28:59.996046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec46d99-65fe-4ef1-8375-fadb11dcd599 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:28:59.997688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 459/927] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:00.004438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc35e-4b12-4b89-a9eb-0518f9f86e78 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.004995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc35e-4b12-4b89-a9eb-0518f9f86e78 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.005506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc35e-4b12-4b89-a9eb-0518f9f86e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.025722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-530dc35e-4b12-4b89-a9eb-0518f9f86e78 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:00.027440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-530dc35e-4b12-4b89-a9eb-0518f9f86e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:00.032812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.033913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.034440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.034959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.042327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.047122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.048840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1a64f00a-9e5f-4e69-be00-c9d7fe715273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:00.070488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:00.071569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:00.072626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:00.072626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:00.072626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:00.072626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:00.074984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 469/928] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:00.077145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf44bf-f8e9-4d84-b4ed-bc02ef2ada44 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.077564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf44bf-f8e9-4d84-b4ed-bc02ef2ada44 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.078285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf44bf-f8e9-4d84-b4ed-bc02ef2ada44 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.080146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 470/929] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:00.081514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf44bf-f8e9-4d84-b4ed-bc02ef2ada44 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.102902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 460/930] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:00.104199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.104489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.104769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.127594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:00.128911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:00.201886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 461/931] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:00.208046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf44bf-f8e9-4d84-b4ed-bc02ef2ada44 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.211577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.245483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.246190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.246487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.246750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.247475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.247784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.249147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.259448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.267258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 471/932] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.267258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.320817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.324091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01147da-10bc-4c5f-85a0-acdb5a3310ca None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.367389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.368875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.369416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.369887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.370691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.372514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.379446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e789583c-3c40-40e3-bcc4-ffa736282a5e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:00.386616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:00.387706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:00.393867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 462/933] 10.222.0.42 () {56 vars in 1132 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:00.394854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.416709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.417673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.417994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.418276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.418937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.420284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:00.432709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:00.433683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:00.434561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 472/934] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:00.435339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.509372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e18bcd-6f79-4906-ba97-ebbfe0b6b8b8 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.511072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.543847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.544754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.545112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.545328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9643e9b-8eab-440d-8edc-593e7ec25aa8 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.545513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.553019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.554582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.560537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:00.570000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:00.571091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:00.572178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:00.578813 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 463/935] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:00.584752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.586297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.586960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.587243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.587516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.588218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.588643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.590076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.594896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 473/936] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.600602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.686874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bed6d4-40ed-47dc-be06-4ce8d5665f43 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.710714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc304f1e-e32a-4a99-8b25-389fb3bf8b52 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.724861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.725605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.725983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.726325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.727102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.727480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.728913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.733951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 464/937] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.734793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.752239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.753311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.753764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.754052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.754845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.755162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.756579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.764948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.769263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 474/938] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.770169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.814509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:00.842467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7280-a188-40a9-93a1-4f2e71983ddc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.877256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.877986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.878299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.878702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.879416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.879579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82acdda-9f83-4255-987d-1c15664eca80 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:00.879726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.881134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.891195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 465/939] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.891195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.920718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:00.921552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:00.921938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:00.922280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:00.923039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:00.923412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:00.925065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:00.930682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 475/940] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:00.931505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:00.986811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:01.003065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67fe3c1-9db0-448b-ae21-d84eda17adb5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:01.038295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:01.039497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.040028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.040493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/5cb3aeb090624fbc9ed64c7bb2ca4d0d/roles/891f64d5451f4aad9c9d7f925fe4014f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.040802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f993e-717b-46cf-8bea-9457d7f27d29 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:01.042512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:01.043722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=5cb3aeb090624fbc9ed64c7bb2ca4d0d, role_id=891f64d5451f4aad9c9d7f925fe4014f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:01.045347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:01.075106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:01.075818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.076387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.076854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.078017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:01.079376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:01.123215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 466/941] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:29:00 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/5cb3aeb090624fbc9ed64c7bb2ca4d0d/roles/891f64d5451f4aad9c9d7f925fe4014f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:29:01.124048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:01.157189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 476/942] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:29:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:01.272445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67463b9-aab9-4810-8acb-df90b1e90779 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:01.321917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:01.322590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.322875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.323152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.323953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] RBAC: Adding query filter params (interface=public, service_id=164ef27d634845e184ffa1852ec2413c, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:01.324270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:01.325643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b045c-59c8-4ae5-8858-f06ef242af10 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:01.332049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 467/943] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:29:01 2022] GET /identity/v3/endpoints?service_id=164ef27d634845e184ffa1852ec2413c&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:01.337450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:01.449216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5355c01-667a-47ed-8a72-b66ca45c1804 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:01.485111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:01.485785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.486105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.486386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.487074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:01.488475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863be52-ff79-4be5-9727-4e852e9da2f4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:01.495548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 477/944] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:29:01 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:29:01.643034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095adc-7f30-40f6-97f4-353026b4d881 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.643576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095adc-7f30-40f6-97f4-353026b4d881 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.643576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24095adc-7f30-40f6-97f4-353026b4d881 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.645771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 468/945] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:01.651128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.651359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.651648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.670024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:01.671227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:01.689792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:01.747803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 478/946] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:01.773784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24095adc-7f30-40f6-97f4-353026b4d881 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:01.786955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:01.887586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24095adc-7f30-40f6-97f4-353026b4d881 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:01.923304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:01.923889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:01.924171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:01.924445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:01.925179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:01.926701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:01.928180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING keystone.server.flask.common [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 03:29:01.986991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.sql.core [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 03:29:01.986991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 03:29:01.986991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [parameters: {'id': 'cc14bf923c7c4b639508b99aa818c126', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 03:29:01.986991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80792) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc14bf923c7c4b639508b99aa818c126.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc14bf923c7c4b639508b99aa818c126. Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:29:02.004645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application result.read() Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 03:29:02.005472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application yield resource Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise self.value Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application session.commit() Jun 24 03:29:02.006440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self.session.flush() Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application compat.raise_( Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 03:29:02.007376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 03:29:02.008275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application result.read() Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:29:02.009091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [parameters: {'id': 'cc14bf923c7c4b639508b99aa818c126', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:02.011190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:02.013077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id cc14bf923c7c4b639508b99aa818c126. Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:02.015343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 469/947] 10.222.0.42 () {60 vars in 1140 bytes} [Fri Jun 24 03:29:01 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:02.025200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:02.128756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c939f-3704-4f76-9340-40a29da13c4c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:02.162881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:02.163668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:02.163948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:02.164217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:02.171069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:02.172503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-0207a8f9-de4f-422f-bd2e-23923320df70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:02.188112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:02.188991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:02.189887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 479/948] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:02.196962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:02.269633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:02.308713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af25756-93b0-4219-a5c4-8a6b6d0a20cb None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:02.342748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:02.343433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:02.343711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:02.343985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:02.344760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:02.345079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:02.346786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bd832-5b1d-4d58-9aeb-a9f2fa290bb9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:02.370133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 470/949] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:03.284959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2472e-78b8-4e4a-ab75-f9e69156b4cd None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.285481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2472e-78b8-4e4a-ab75-f9e69156b4cd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.285701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2472e-78b8-4e4a-ab75-f9e69156b4cd None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.287467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 480/950] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:03.292892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.293304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.293645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.311535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:03.313038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:03.345112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b779-9e9c-4889-a0c0-461eee383627 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.345431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b779-9e9c-4889-a0c0-461eee383627 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.345681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059b779-9e9c-4889-a0c0-461eee383627 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.347495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 481/951] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:03.352286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.352576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.352857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.369873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:03.371084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:03.379389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:03.389162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 471/952] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:03.419687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.450319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 482/953] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:03.476421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.508662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:03.552794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327abf3-4408-477e-bae6-9b1d16bcaefb None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:03.585263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b7e24-fee5-42c4-9837-d8415d6d2d5e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:03.601491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:03.602583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.602961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.603314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.619685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:03.628069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:03.629637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:03.630049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:03.631040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:03.631930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:03.633236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.633720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.634624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:03.636319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 472/954] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:03.636600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:03.637151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d45a2a5c-e6df-4e0c-9af1-6d2c5fa318eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:03.650911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:03.652111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:03.653335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 483/955] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:03.654464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc007-5737-41f0-a35f-faf6c24b1e67 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.654464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc007-5737-41f0-a35f-faf6c24b1e67 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.654464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc007-5737-41f0-a35f-faf6c24b1e67 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.655613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 484/956] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:03.658643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc007-5737-41f0-a35f-faf6c24b1e67 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.667843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:03.751670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bf6ee-7e8d-4733-82cf-889a029e3f6a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:03.767762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc007-5737-41f0-a35f-faf6c24b1e67 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:03.768569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:03.787763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:03.788435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.788721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.788995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.789755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:03.790078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:03.791426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13411c-1fbe-4f61-9076-a2a564c61d8e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:03.799729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 473/957] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:03.800938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.801227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.801505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.810347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:03.810950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.811232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.811510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.812209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:03.812515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:03.813885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:03.819728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 485/958] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:03.820498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.825279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:03.826505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:03.895190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:03.896596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 474/959] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:03.896944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:03.944469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227878a4-8bd6-4d56-b3e0-55b92a6bc81c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:03.984265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:03.985040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:03.985319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:03.985592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:03.999687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.001152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.014863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32832eeb-b5c7-4d16-aacd-c1147c999153 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:04.020281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:04.021176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 486/960] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:04.026852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.030331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.060445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.061572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.062339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.062765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.064226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:04.064536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.067829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.081884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 475/961] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:04.081884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.144748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5801-11a3-4af3-950c-8ab53703f7f6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.176941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.192112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e463f8-220a-439d-9109-308577b1185c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.193324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e463f8-220a-439d-9109-308577b1185c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.193677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e463f8-220a-439d-9109-308577b1185c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.194049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e463f8-220a-439d-9109-308577b1185c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.194950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e463f8-220a-439d-9109-308577b1185c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.196756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e463f8-220a-439d-9109-308577b1185c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-27e463f8-220a-439d-9109-308577b1185c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:04.211440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:04.212489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:04.213301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:04.216868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 487/962] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:04.218968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b3ef9-fe21-47b0-b9c8-c52729beba0c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.223596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e463f8-220a-439d-9109-308577b1185c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.261894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.261894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.261894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.261894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.262641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:04.262943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.264392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.278494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 476/963] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:04.283727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.324151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.368920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e463f8-220a-439d-9109-308577b1185c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.414853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a621842-b394-45d3-bd11-c6952770fad4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.416627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.418368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.418653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.418928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.419634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:04.419940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.422355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.435962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 488/964] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:04.437635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.458585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.459509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.459707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.459946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.470506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.472576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:29:04.487519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:04.489031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 03:29:04.490009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:04.494118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 477/965] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:04.495450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.507465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.565675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba07a3-3f1c-43c4-8de0-860b5e189a47 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.594634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.601783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.602473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.602752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.615395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.615395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:04.615395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.615678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41295ed-11c2-4f39-a113-b86f69ae138e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbede09-8e8b-427e-9db7-43aa608452d0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 489/966] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e503-052c-4193-af93-de002350c3d6 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e503-052c-4193-af93-de002350c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed28e503-052c-4193-af93-de002350c3d6 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.615757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 490/967] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:04.617502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e503-052c-4193-af93-de002350c3d6 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.652377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.653056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.653340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.653616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.654513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:04.654818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.656388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b553110-e6ab-4c97-8463-87477886f2bb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.679556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 478/968] 10.222.0.42 () {56 vars in 1149 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:04.679556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.679556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.679556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.695909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:04.697110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:04.727287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed28e503-052c-4193-af93-de002350c3d6 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.744582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.766150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.766838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.767126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.767411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.768158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:04.774111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 479/969] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:04.774111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.774312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:04.826703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 491/970] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:29:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:04.827801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:04.875190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:04.896960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa3d8e-7087-4f4a-bc04-bc7eab4f36c5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:04.942211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:04.942873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:04.943157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:04.943462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:04.991336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670cdb6-17dc-4956-be8e-bfda9976728e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.035296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.036988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.038196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.038880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.039166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.039557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.040141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.041557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.042976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING keystone.server.flask.common [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 03:29:05.094253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.sql.core [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 03:29:05.094253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 03:29:05.094253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [parameters: {'user_id': '0670a1160bd34ca0bd8ce9071690d1f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 03:29:05.094253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80791) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result.read() Jun 24 03:29:05.107271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:29:05.108303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application yield resource Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application next(self.gen) Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise self.value Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application session.commit() Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 03:29:05.109458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.session.flush() Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application compat.raise_( Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 03:29:05.111569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 03:29:05.114209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application conn.query(q) Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application result.read() Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 03:29:05.116558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [parameters: {'user_id': '0670a1160bd34ca0bd8ce9071690d1f0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:05.118806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 03:29:05.119956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 492/971] 10.222.0.42 () {60 vars in 1131 bytes} [Fri Jun 24 03:29:04 2022] POST /identity/v3/users => generated 160 bytes in 281 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:05.122267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.138619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:05.155822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:05.166262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 480/972] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:04 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:05.172352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.237111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09061-bb3b-48ae-a0b3-ddc55179ed77 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.277528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.278704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.279196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.279700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.284015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5917fd-7bb6-41d7-849a-e462836b21c6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.288094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.290131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:29:05.305302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:05.306311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 03:29:05.307323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.314596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 493/973] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:05.315693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.320903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.321916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.322205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.322482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.334232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.335672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:05.354882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:05.355870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:05.356750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:05.356750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:05.356750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:05.356750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:05.360830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 481/974] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:05.361921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.393160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:05.417984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:05.427013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70301e-8b09-4905-9f61-501cfe3dc016 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.463070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.464003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.464386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.464768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.465803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:05.466503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.467886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.475568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76105ce-d60a-4aa3-8cb7-bc462d723bc2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.514205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 494/975] 10.222.0.42 () {56 vars in 1101 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:05.525089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.526174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.526611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.527035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.527941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:05.528403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.530051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.544114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 482/976] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:05.550594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.665883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a52f1-eaed-4a6f-bf2a-ba40883a72a5 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.701666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.702553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.702840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.703117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.710863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.712303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:05.727067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:05.728003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:05.728895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 495/977] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:05.735583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.830526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:05.843042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c302e1-0ac9-4d17-962b-3e4b2b201b30 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:05.876644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:05.877740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:05.879166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:05.879442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:05.880236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:05.880547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:05.882008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380f1a0-ceb0-47dc-be77-2e8264db20f9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:05.894857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 483/978] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:05.900566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:05.914038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:06.006738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961716a-a375-4f32-888a-acf6bd89e2af None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:06.044016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:06.044673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.044957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.045231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.046080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] RBAC: Adding query filter params (role.id=891f64d5451f4aad9c9d7f925fe4014f, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:06.046392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:06.047802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34f330f-c697-4142-a4ae-2366824c6de0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:06.054133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 496/979] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:05 2022] GET /identity/v3/role_assignments?user.id=5cb3aeb090624fbc9ed64c7bb2ca4d0d&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=891f64d5451f4aad9c9d7f925fe4014f => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:06.158980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7af0b-4cc0-47ca-9dd9-367dbffdf437 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.159305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7af0b-4cc0-47ca-9dd9-367dbffdf437 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.160040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7af0b-4cc0-47ca-9dd9-367dbffdf437 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.161573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 484/980] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:06.167243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5e60c-f90e-4f35-949e-e90a00c3fed3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.167536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5e60c-f90e-4f35-949e-e90a00c3fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.167818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5e60c-f90e-4f35-949e-e90a00c3fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.186078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-92e5e60c-f90e-4f35-949e-e90a00c3fed3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:06.187632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-92e5e60c-f90e-4f35-949e-e90a00c3fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:06.261580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 497/981] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:06.285643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7af0b-4cc0-47ca-9dd9-367dbffdf437 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:06.389657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7af0b-4cc0-47ca-9dd9-367dbffdf437 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:06.424682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:06.425379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.425661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.425962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.426703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:06.428057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a635e865-28ea-44a7-8623-7bebaee35502 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:06.506776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 485/982] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:29:06 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:06.953952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf697d7-38de-46a0-bdc3-b2f3d13db1f1 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.954468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf697d7-38de-46a0-bdc3-b2f3d13db1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.954546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf697d7-38de-46a0-bdc3-b2f3d13db1f1 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.956085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 498/983] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:06.961566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:06.961862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:06.962156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:06.979429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:06.980602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:06.982646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:07.055730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 486/984] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:07.078172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf697d7-38de-46a0-bdc3-b2f3d13db1f1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:07.083978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:07.183015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf697d7-38de-46a0-bdc3-b2f3d13db1f1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:07.219598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:07.220379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:07.220657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:07.220928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:07.221679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:07.223809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:07.236197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:07.237180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:07.238461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:07.242216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 499/985] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:07.243600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:07.352149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5eafcd-eb42-4ad5-a514-d3234400eb9a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:07.385824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:07.386524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:07.386810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:07.387149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:07.387860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:07.388169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:07.389528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:07.390605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:07.396285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 487/986] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:07.401814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:07.468524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:07.502613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f0238-d4d7-4ca8-ad41-8d1c12217299 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:07.537044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:07.537697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:07.538009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:07.538284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:07.538985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:07.539292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:07.540638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:07.550631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 500/987] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:07.551580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:07.655335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ad68-926c-42ce-9278-8c90280f165e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:07.689674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:07.690364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:07.690646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:07.691478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:07.692271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] RBAC: Adding query filter params (interface=admin, service_id=164ef27d634845e184ffa1852ec2413c, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:07.692581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:07.693951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0a75-c2d0-40b9-a016-e900948e61fb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:07.703555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 488/988] 10.222.0.42 () {56 vars in 1249 bytes} [Fri Jun 24 03:29:07 2022] GET /identity/v3/endpoints?service_id=164ef27d634845e184ffa1852ec2413c&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:07.704815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:07.808462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd0dbe-8991-4f16-8e7c-2a8cb7a01f25 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:07.837776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:07.843359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:07.844053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:07.844344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:07.844625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:07.845302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:07.846702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e764d1-6171-4b3e-9379-77f2614021e8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:07.853142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 501/989] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:29:07 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:29:08.143081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98271-daea-4153-8b25-bd3bbeeb873c None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.143407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98271-daea-4153-8b25-bd3bbeeb873c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.143642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d98271-daea-4153-8b25-bd3bbeeb873c None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.145816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 489/990] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:08.150852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.151309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.151453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.169122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:08.170361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:08.249888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 502/991] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:08.270529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98271-daea-4153-8b25-bd3bbeeb873c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:08.336992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:08.376616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d98271-daea-4153-8b25-bd3bbeeb873c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:08.411408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:08.412130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.412388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.412656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] PATH_INFO: `/v3/services/image` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.413302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:08.414675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-9940d016-d472-4de9-8b99-b47a6ab1db18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:08.426013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:08.426996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:08.427855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.430186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 490/992] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 03:29:08 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:08.432980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:08.534471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997fff0-2bc8-4f94-bfeb-6a1cc63f2733 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:08.560681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:08.570449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:08.571127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.571419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.571731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.572448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] RBAC: Adding query filter params (name=image) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:08.572759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:08.574402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:08.575925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07354-aa4b-4f70-ad39-75abae491ff4 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.576215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07354-aa4b-4f70-ad39-75abae491ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.576492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07354-aa4b-4f70-ad39-75abae491ff4 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.578023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 491/993] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:08.583773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 503/994] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:08.583898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.583898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.583898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.584610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:08.601101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:08.602328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:08.673098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 492/995] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:08.691910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01f44a-6f7b-4218-9912-45cf39c5df51 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:08.696678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:08.729909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:08.730603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.730953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.731133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.731831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] RBAC: Adding query filter params (type=image) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:08.732142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:08.733499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:08.738781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 504/996] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:08.765273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:08.812771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927041a3-8cc3-42f8-9810-197a75ea1106 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:08.850802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:08.851620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:08.851905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:08.852180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:08.852842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:08.854273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:08.866705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:08.868036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:08.868878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:08.870373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 493/997] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:08.874538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:08.942411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:08.993767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eddc88-20c8-455a-8799-7cf11e142418 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:09.030349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:09.031021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.031305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.031581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.032289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:09.032602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:09.033992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:09.044290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 505/998] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:09.045233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:09.148019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1584d79c-0533-4ebd-86f2-f883ddfda3bf None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:09.168124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:09.182921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:09.186127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.186127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.186127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.186127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:09.186127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:09.186590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:09.191686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 494/999] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:09.197220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:09.305819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1afe2e-598c-419d-bf31-dca65f0d0bd1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:09.322353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:09.339289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:09.339943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.340226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.340502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.341280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] RBAC: Adding query filter params (interface=public, service_id=06b5d3fbc82a432bac82d16b1a282074, region_id=RegionOne) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:09.341592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:09.342976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e414076a-f5aa-4bff-9a63-373ec461a2b7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:09.353025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 506/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:29:09 2022] GET /identity/v3/endpoints?service_id=06b5d3fbc82a432bac82d16b1a282074&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:09.354318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:09.456176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45631345-f3cb-41f8-9d15-33a47f8be1e7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:09.490240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:09.490905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.491184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.491456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.492129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:09.493740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd6bc9-9d78-4ab8-9bc8-8c41dfe5aa72 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:09.505889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 495/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:29:09 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:29:09.905694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f13ec-2e02-43f2-9384-65ac9707712e None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.906090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f13ec-2e02-43f2-9384-65ac9707712e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.906298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f13ec-2e02-43f2-9384-65ac9707712e None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.907826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 507/1002] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:09.912859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:09.913147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:09.913428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:09.930078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:09.931260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:09.980545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:10.009489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 496/1003] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:10.027721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f13ec-2e02-43f2-9384-65ac9707712e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:10.132627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f13ec-2e02-43f2-9384-65ac9707712e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:10.167348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:10.168079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.168423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.168701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.169376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:10.170768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:10.183415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:10.184447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 03:29:10.185288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:10.189642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 508/1004] 10.222.0.42 () {56 vars in 1126 bytes} [Fri Jun 24 03:29:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:10.190725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:10.291446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598caaa-3837-467b-a92e-5c26b1d5963a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:10.325824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:10.326512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.326797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.327074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.327776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:10.328081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:10.329438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:10.334478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 497/1005] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:10.339969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:10.387636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:10.441405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8b7d0-bc30-47bd-96a3-26b7908e7155 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:10.475235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:10.475897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.476181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.476457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.477169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:10.477509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:10.479004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d00e954-cbc7-42de-9707-9426589f2509 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:10.489311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 509/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Fri Jun 24 03:29:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:10.490469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:10.533804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:10.590743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0a4c9-ebff-41e0-916d-1e0e55662317 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:10.627926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:10.628648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.628932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.629207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.629967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:10.631323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddab75-e966-49a1-bd01-6f393be31e41 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:10.697980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 498/1007] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:29:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:10.768479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92abd-31fd-442b-9f56-ef3e362a5e21 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.769307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92abd-31fd-442b-9f56-ef3e362a5e21 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.769594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d92abd-31fd-442b-9f56-ef3e362a5e21 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.771051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 510/1008] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:10.776804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe86d02-03ea-462b-83c3-58669995f926 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:10.777100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe86d02-03ea-462b-83c3-58669995f926 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:10.777382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe86d02-03ea-462b-83c3-58669995f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:10.795295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-bfe86d02-03ea-462b-83c3-58669995f926 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:10.796506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bfe86d02-03ea-462b-83c3-58669995f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:10.874264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 499/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:10.897152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92abd-31fd-442b-9f56-ef3e362a5e21 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:11.007642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d92abd-31fd-442b-9f56-ef3e362a5e21 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:11.019733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:11.044195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:11.044864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:11.045152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:11.045433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:11.046202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:11.047574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecddc759-e719-4033-b2cb-6b0cd5a60d3f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:11.125719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 511/1010] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:29:10 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:11.540435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcee2b-8038-460d-b515-42d32c2069ec None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:11.540951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcee2b-8038-460d-b515-42d32c2069ec None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:11.541052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcee2b-8038-460d-b515-42d32c2069ec None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:11.542423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 500/1011] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:11.547423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:11.547813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:11.547981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:11.564326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:11.565645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:11.641090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 512/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:11 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:11.665038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcee2b-8038-460d-b515-42d32c2069ec None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:11.694101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:11.766852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcee2b-8038-460d-b515-42d32c2069ec None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:11.803029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:11.803747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:11.804032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:11.804307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] PATH_INFO: `/v3/services/compute` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:11.804955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:11.806350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:11.818659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:11.819714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:11.820650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 501/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:11.826327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:11.923637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:11.929995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166831dd-14c0-4672-b3bd-ee2862e59d84 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:11.964513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:11.965179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:11.965468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:11.965751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:11.966502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:11.966816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:11.968181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:11.977776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 513/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:11.979704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:12.073808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:12.082997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f7c79-eefb-47d7-b059-fae0b2bf22ed None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:12.116901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:12.117819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:12.118136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:12.118417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:12.119126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:12.119438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:12.120807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738938c-ce43-4725-8870-9b8a898cf3fb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:12.131004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 502/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Fri Jun 24 03:29:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:12.132125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:12.240348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc867b-3b15-4333-b466-331dd2d74813 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:12.276105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:12.276771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:12.277059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:12.277340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:12.278195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:12.279562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c75959-44c4-4717-be36-c7189fb98682 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:12.368269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 514/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:29:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:12.782250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303fc8-c663-4c3f-8ead-df0a3627ae9e None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:12.782756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303fc8-c663-4c3f-8ead-df0a3627ae9e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:12.782756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3303fc8-c663-4c3f-8ead-df0a3627ae9e None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:12.784111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 503/1017] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:12.789790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:12.790206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:12.790371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:12.808320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:12.809502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:12.820556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:12.885748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 515/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:12.909799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303fc8-c663-4c3f-8ead-df0a3627ae9e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.017865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3303fc8-c663-4c3f-8ead-df0a3627ae9e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.052085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.052797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.053076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.053340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.054536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.055953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3148d4-6c59-49a4-a450-603a91c40bd9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.062353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 504/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:13.063539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.162301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d47d3-d0af-45de-98f9-77b029b02089 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.167631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a9a6-a9fb-44c3-bb58-32ae34f652ad None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.167918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a9a6-a9fb-44c3-bb58-32ae34f652ad None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.168201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1a9a6-a9fb-44c3-bb58-32ae34f652ad None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.169764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 505/1020] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:13.174338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc353-1a77-4291-878c-3786e212c05a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.174626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc353-1a77-4291-878c-3786e212c05a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.178872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc353-1a77-4291-878c-3786e212c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.191705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-529bc353-1a77-4291-878c-3786e212c05a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:13.193542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-529bc353-1a77-4291-878c-3786e212c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:13.203582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.204250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.204601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.204822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.205603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.207554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.212841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:13.221406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:13.263601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 506/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:13.278126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 516/1022] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:29:13 2022] POST /identity/v3/projects => generated 311 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:13.288371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc353-1a77-4291-878c-3786e212c05a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.397369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc353-1a77-4291-878c-3786e212c05a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.437002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.437810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.438164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.438443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] PATH_INFO: `/v3/services/image` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.439102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.441005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:13.454494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:13.455497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:13.456900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 507/1023] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 03:29:13 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:13.462256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.564712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf30dbf-29e8-4242-ad95-b6377e0df62d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.600752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.601424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.601710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.602023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.602742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:13.603056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.604427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.609567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 517/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:13.615470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.636160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:13.718069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4211465-2070-4268-89da-a38fe038d105 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.751645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.752315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.752599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.752970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.754219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] RBAC: Adding query filter params (type=image) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:13.754529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.755875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.760919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 508/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:13.766575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:13.827194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:13.869458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8efa4-a9a7-42f7-aaf0-0a0bdb36bad9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:13.904201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:13.904856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:13.905138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:13.905412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:13.906279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] RBAC: Adding query filter params (interface=public, service_id=aaefbf39af4340faa80a6bbb9c297620, region_id=RegionOne) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:13.906591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:13.907944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb4c04-f1fe-46a2-bdfa-9aa9554992de None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:13.918233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 518/1026] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:29:13 2022] GET /identity/v3/endpoints?service_id=aaefbf39af4340faa80a6bbb9c297620&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:13.919404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:14.012347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:14.030116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f822a5-ad11-44ad-acf5-e4282cb59855 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:14.065163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:14.066528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:14.066815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:14.067090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:14.067769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:14.069125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c3a834-fa36-42be-857d-cae40843ac0c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:14.082110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 509/1027] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:29:13 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:29:14.496315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ef8-d4ff-46fd-a773-4edcce969736 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:14.496667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ef8-d4ff-46fd-a773-4edcce969736 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:14.496869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda92ef8-d4ff-46fd-a773-4edcce969736 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:14.498423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 519/1028] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:14.504023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:14.504312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:14.504590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:14.521309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:14.522499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:14.590103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 510/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:14.613444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda92ef8-d4ff-46fd-a773-4edcce969736 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:14.714322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda92ef8-d4ff-46fd-a773-4edcce969736 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:14.736438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:14.753556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:14.753556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:14.753556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:14.753556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:14.760684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:14.768848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:14.769745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:14.770640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:14.774186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 520/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:29:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:14.776044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:14.855030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:14.879538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f547ad-1da3-4bd1-abf2-b2c91d42a264 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:14.914343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:14.915015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:14.915297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:14.915571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:14.916309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:14.916616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:14.917995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:14.931033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 511/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:29:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:14.933149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.043596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764af34-503b-4e4b-a96e-7205efff9ab1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.077450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.078262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.078544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.078813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.088788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.090262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:15.107868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:15.108736 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:15.114861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:15.114861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:15.114861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:15.114861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:15.114861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 521/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:15.116801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.220162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4482260d-29f2-4cf8-8e05-2ebe9410e432 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.254607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.255270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.255555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.255828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.256543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:15.256848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.258231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871998ed-f55a-49ce-8535-5204b10ea717 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.265288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:15.276041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 512/1033] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:15.277435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.313423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:15.362908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488a1c-cb7c-4624-a568-721fab7846b7 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.363238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488a1c-cb7c-4624-a568-721fab7846b7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.363473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488a1c-cb7c-4624-a568-721fab7846b7 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.364866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 513/1034] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:15.370010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.370341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.370658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.381843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71f2bb-fcd7-426f-a5cb-fe4485c4c2a5 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.386689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:15.387858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:15.418603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.419384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.419666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.419943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.427287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.428709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:29:15.442767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:15.443732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:15.444679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:15.448694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 522/1035] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:15.449746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.465883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 514/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:15.486828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.556885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:15.563672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53070eb1-3022-42e4-bc8d-d5f647c98f2c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.590300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e532a24-7f8d-41b2-b289-ad847d27ab33 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.601781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.602483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.602768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.603046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.603999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:15.604314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.605878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.616912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:15.629838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 523/1037] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:15.630083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.630083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.630083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.630083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.630435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.630435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.632307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 515/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:15.632422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.637065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:15.737363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b512775-0653-4223-bfcb-893db977dc2d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.756529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237500e-b6c2-40bb-ba4b-2e95b81b848b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:15.772659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.773330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.773617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.773916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.774631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.776057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.797109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:15.801093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:15.801093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:15.801093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:15.819587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:15.864951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:15.866440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:15.902360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 516/1039] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:29:15 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:15.974575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 524/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:29:15.984694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.047434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.097806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e20cd7-47d1-4bcb-9e71-072f1cf052b2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.134428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.135233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.135517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.135791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.147826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.149286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c56223b6-67b9-45dd-b4da-daf38a4d008d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:16.166415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:16.167303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:16.168341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:16.168341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:16.168341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:16.168341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:16.168341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 517/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:16.175327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.194390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f758-6efe-4b24-93c0-43a9fd219ac6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.194682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f758-6efe-4b24-93c0-43a9fd219ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.194961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62f758-6efe-4b24-93c0-43a9fd219ac6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.196591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 518/1042] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:16.201492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.201828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.202058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.219077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:16.219925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:16.233460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.284193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1dcff3-39e7-4dfa-bc2e-58d93432b0d9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.294478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 519/1043] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:16.318731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.322706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.323370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.323648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.323919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.324634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:16.324936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.326327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.339811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 525/1044] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:16.346264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.358668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.428372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b901a78-e4ff-4616-9d70-fb9916e185ad None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.463301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.464064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce32548-2cd3-4be0-856c-f01fee0bccac None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.464178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.464357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.464632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] PATH_INFO: `/v3/services/image` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.465282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.466673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:16.478557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:16.479544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:16.480456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 520/1045] 10.222.0.42 () {56 vars in 1105 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:16.481248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.485822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.505012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.505802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.506120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.506393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.513184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.515005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:16.528813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:16.529751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:16.530670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:16.534504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 526/1046] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:16.536408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.594546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.599238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566b5b-a427-4745-9e47-a2aa8d33b60a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.634448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.635030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.635314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.635583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.636279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:16.636588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.637956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.642566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01fc51-89de-4b20-994b-d579d7cad6bf None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.643358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 521/1047] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:16.648719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.679156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.679920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.680209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.680492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.681283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:16.681600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.683457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.701806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 527/1048] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:16.703830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.734119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.763697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636ba21-e163-40ff-b9d9-50c456ed03a6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.800383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.801044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.801332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.801611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.802358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] RBAC: Adding query filter params (type=image) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:16.802669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.804043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.806177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49524c1a-1fa2-4118-90ec-8d2d0b69eedc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.809108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 522/1049] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:16.814796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:16.843357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.844005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.844289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.844563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.845377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] RBAC: Adding query filter params (role.id=891f64d5451f4aad9c9d7f925fe4014f, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:16.845701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.847175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa03e0f-6d4c-4972-a982-ea993ca71ed3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:16.847360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:16.861880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 528/1050] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:16 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=891f64d5451f4aad9c9d7f925fe4014f => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:16.927728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdacf29-a550-4ade-9f05-682facf15879 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:16.963957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:16.964639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:16.964926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:16.965204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:16.965994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:16.967394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c53e3-2a8f-42fa-b2d4-7cc099590ac4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:17.055251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 523/1051] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:29:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:18.025156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2505ed-e82f-456b-97c8-d9c517f9bd14 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.025634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2505ed-e82f-456b-97c8-d9c517f9bd14 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.025712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2505ed-e82f-456b-97c8-d9c517f9bd14 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.027139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 529/1052] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:18.032169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.032458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.032732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.050300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:18.051464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:18.124868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 524/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:18.148904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2505ed-e82f-456b-97c8-d9c517f9bd14 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:18.250783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:18.257925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2505ed-e82f-456b-97c8-d9c517f9bd14 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:18.293045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:18.293838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.294152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.294432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.304737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:18.312302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:18.313220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:18.314106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 530/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:18.319440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:18.329649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:18.419667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff363b9-a53c-4c2b-91a4-47aac823ff48 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:18.453467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:18.454167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.454458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.454736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.455479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:18.456304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:18.457669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:18.466098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 525/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:18.472152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:18.574977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7d0ca-4eac-4956-8825-ab6eb78f2b0f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:18.608391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:18.609257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.609542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.609819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] PATH_INFO: `/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.623988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] RBAC: Authorizing `identity:get_user(user_id=3a9d3f12da394c04b5e6ce92f3fd817c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:18.625501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835c94-bc92-4379-a879-cf49fbb4ac49 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:18.631955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 531/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:18.633004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:18.703075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:18.735740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edcd1c9-eb3e-4a96-9e84-5a1504876495 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:18.770296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:18.770952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.771236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.771513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.838917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:18.840373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:18.867082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7ab3-dc79-4215-8cd9-6eeebcb98110 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.867636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7ab3-dc79-4215-8cd9-6eeebcb98110 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.867929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab7ab3-dc79-4215-8cd9-6eeebcb98110 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.869896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 532/1057] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:18.874246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:18.874532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:18.874806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:18.891643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:18.892830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:18.903822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:18.915890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:18.952325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 526/1058] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:18.953872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:18.985872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 533/1059] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:19.001005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.074279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2838a06-c2ab-4767-b90a-aa8c9256b4e0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.098897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1b0f-695d-4b52-90ce-34e81cf71a9f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.110314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.111181 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.111467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.111744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.113454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.114906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.116955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 527/1060] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:19.122732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.139927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.140741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.141051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.141304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.151578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-603441c8-19ff-471b-932f-736e8a6ae27d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:19.159649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:19.160733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:19.161570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 534/1061] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:29:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:19.162291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38964f8-eaba-44b0-b4e1-ecca1de7d06b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.162359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38964f8-eaba-44b0-b4e1-ecca1de7d06b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.162679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38964f8-eaba-44b0-b4e1-ecca1de7d06b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.164072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 535/1062] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:19.166651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38964f8-eaba-44b0-b4e1-ecca1de7d06b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.166892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.170697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.222352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1209b-ba95-4ca2-a063-36b5db2d5ba6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.257239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.257908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.258194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.258473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.259294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0, user.id=3a9d3f12da394c04b5e6ce92f3fd817c) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:19.259606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.261019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4825e58a-a7a5-4cfe-b79c-022feb9326ea None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.266489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 528/1063] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/role_assignments?user.id=3a9d3f12da394c04b5e6ce92f3fd817c&scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:19.267632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.267915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.268217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.275421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38964f8-eaba-44b0-b4e1-ecca1de7d06b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.290804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:19.292034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:19.319528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.320357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.320647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.321181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.321780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:19.322213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.323566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.337583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 536/1064] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:19.338777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.375219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 529/1065] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:19.398337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.414860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.443041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.452044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52d9231-7c63-413f-963e-4a55588ada67 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.489327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.490159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.490443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.490775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.503593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.505174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.517669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa7418-b58a-47ed-997f-abe3e3ac39f1 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:19.523472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:19.524358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:19.525244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:19.525244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:19.525244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:19.525244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:19.525244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 537/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:19.530267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.555041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.555985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.556457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.556956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.628701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57e59-9738-4774-8c7a-7c1355d40d2b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.630518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.632249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.645652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.662103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.662778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.663049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.663324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.666090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:19.666090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.666247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.666322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.682349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 538/1067] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:19.684826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.746088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 530/1068] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:29:19.747140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.796726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a7472-c038-4de6-8a1b-62ddccf15e31 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.833420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.834245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.834526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.834803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.841980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.843413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.852693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fe1d6-ff99-4d1d-b8d5-d71831f721a2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:29:19.857606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:19.858723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:19.859682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 539/1069] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:19.864926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.889393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.896122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:19.897132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:19.897592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:19.897803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:19.906571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:19.908478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:19.910248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:19.927450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:19.928332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:19.929378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:19.929378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:19.929378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:19.929378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:19.929378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 531/1070] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:19.934417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:19.970184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a0981-a1a2-4d42-a5ad-76d2b7ea5445 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.014042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.014713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.014995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.015268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.016344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:20.016463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.017801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.037362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 540/1071] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:20.042772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:20.044067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee98215-c07e-4f64-9ac1-a9b2859528d7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.078393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.079068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.079317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.079587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.080300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:20.081123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.082502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.094132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 532/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:20.147756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:20.154323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af99d5-ce16-4b08-bf05-4e28e8c9a653 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.191219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.192028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.192308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.192576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.204026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.205647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:20.225043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:20.236095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:20.237034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:20.237034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:20.237034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:20.237034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:20.237034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 541/1073] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:20.237329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:20.283683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:20.343749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bac2bf-540d-422c-9217-bd95857bbbe8 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.381285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.381979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.382261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.382531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.383260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:20.383560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.384902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.397374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 533/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:20.403350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:20.500818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07252e0-e5c0-48e4-8409-acf75c21a60a None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.534326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.535103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.535390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.535670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.542246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.543671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:20.557575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:20.558644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:20.559715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:20.562006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 542/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:20.564627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:20.660490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c9689-6e49-4cd6-b78b-7a17aeff97b5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.662674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:20.693668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.694360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.694992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.695267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.696046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:20.696353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.697760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff29b7-46ee-4988-86de-0b6da0939d59 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.708921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 534/1076] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:20.714785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:20.725935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:20.812864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f8f4c-4682-48dd-83c1-6e2c193080fc None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:20.845566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:20.847022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:20.847301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:20.847573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/891f64d5451f4aad9c9d7f925fe4014f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:20.849748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=99eac0e91e884f4c8e1c93f7f66d43a5, role_id=891f64d5451f4aad9c9d7f925fe4014f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:20.851197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5538948-0950-4a43-9180-da3ae8536a75 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:20.911232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 543/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:29:20 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/99eac0e91e884f4c8e1c93f7f66d43a5/roles/891f64d5451f4aad9c9d7f925fe4014f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:29:21.298944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945700fa-f889-4f0a-9408-12b68eb981b9 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:21.299509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945700fa-f889-4f0a-9408-12b68eb981b9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:21.299509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945700fa-f889-4f0a-9408-12b68eb981b9 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:21.300907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 535/1078] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:21.306450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:21.306873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:21.306984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:21.323373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:21.324565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:21.385681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:21.391287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 544/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:21.415222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945700fa-f889-4f0a-9408-12b68eb981b9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:21.514718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945700fa-f889-4f0a-9408-12b68eb981b9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:21.547907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:21.548695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:21.549032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:21.549774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:21.560193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:21.568319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:21.569479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:21.570394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 536/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:21.575793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:21.672142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c5793-ce2b-4607-b47d-e3803360a568 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:21.705010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:21.705695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:21.706008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:21.706286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:21.707027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:21.707336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:21.708696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:21.716545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 545/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:21.723140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:21.748387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:21.820228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a56f8d-28bb-4f4a-a3ea-7ed6f27bcea1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:21.853297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:21.854186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:21.854472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:21.854749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] PATH_INFO: `/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:21.855939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] RBAC: Authorizing `identity:get_user(user_id=3a9d3f12da394c04b5e6ce92f3fd817c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:21.857361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:21.859025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 537/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:21 2022] GET /identity/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:21.865461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:21.923847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:21.965029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd978b-c258-43cf-af53-21ca676e438f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:22.002768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:22.003639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:22.003927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:22.004208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:22.005396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:22.006859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569b183-f5ef-4e9a-9746-47cb29df1c99 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:22.008578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 546/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:21 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:22.014553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:22.104207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:22.113141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d5b91-7539-43f3-acbd-fe3fb9d30bec None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:22.147325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:22.148258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:22.148543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:22.148821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0/users/3a9d3f12da394c04b5e6ce92f3fd817c/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:22.150805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a331204dd32d45ebb4fd7b1f21763bb0, user_id=3a9d3f12da394c04b5e6ce92f3fd817c, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:22.152212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb20b9-aebb-4497-9ff6-58575f7b0ea9 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:22.201730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 538/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:29:22 2022] PUT /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0/users/3a9d3f12da394c04b5e6ce92f3fd817c/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:29:22.907385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3e3e-01b6-4956-be04-e5992a021377 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:22.907894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3e3e-01b6-4956-be04-e5992a021377 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:22.908001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3e3e-01b6-4956-be04-e5992a021377 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:22.909377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 547/1085] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:22.914545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:22.914930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:22.915097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:22.932863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:22.934065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:23.005097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 539/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:23.028679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef3e3e-01b6-4956-be04-e5992a021377 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.126997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef3e3e-01b6-4956-be04-e5992a021377 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.151999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:23.160132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.160879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.161164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.161438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.171168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:23.179873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:23.180767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:23.181757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 548/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:23.187015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.265393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:23.284810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9947bf-018b-43c9-903e-55086be3c1be None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.320034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.320692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.320971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.321244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.322015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:23.322320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:23.323667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:23.331514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 540/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:23.337167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.435661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a4099-3fa2-4f2a-a199-c5f8cffaf9f7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.467726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.468493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.468775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.469050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.479702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:23.481118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:23.497660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:23.498698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:23.499607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:23.499607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:23.499607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:23.499607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:23.499607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 549/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:23.504457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.601011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1723a7-5c72-48af-a20e-09b1e64035e3 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.633402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.634088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.634370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.634646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.635355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:23.635657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:23.636996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:23.648981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 541/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:23.654445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.696336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:23.753148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4e9e-af31-4a72-8d2b-fed5bdbfc6db None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.785190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.786015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.786306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.786584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.794068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:23.795498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:29:23.809728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:23.810964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:23.811896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 550/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:23.817288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:23.821452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:23.915185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce76d4-a16d-4a48-a0e3-f41c2a006fea None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:23.947936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:23.948537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:23.948818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:23.949094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:23.949953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:23.950261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:23.951666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53ac5-fd3f-4b21-8d63-174ca9591e5f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:23.968224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 542/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:23.974656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.071775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.074970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c76bab-307d-4c41-875b-7c96885fd7cb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.108018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.108655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.108938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.109213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.173787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.175823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.204672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b29d-2526-41e6-823f-3993b4ca0d5e None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.204884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b29d-2526-41e6-823f-3993b4ca0d5e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.205168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20b29d-2526-41e6-823f-3993b4ca0d5e None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.207107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 543/1093] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:29:24.211889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.212178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.212453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.229046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:24.230246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:24.269592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.273905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 551/1094] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 03:29:24.279003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.287357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.297592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 544/1095] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 03:29:24.320958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.377695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095ff87-2989-45b9-8bf3-ad07f7b44755 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.412772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.413552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.413841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.414144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.422392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5178816-09f9-4c5d-9a70-eeeb8d51b16a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.424050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.425470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:24.442260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:24.443174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:24.444058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:29:24.444058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:24.444058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:29:24.444058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:24.444058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 552/1096] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:24.449017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.456618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.457343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.457625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.457929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.467925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:24.475945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:24.476866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:24.477703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 545/1097] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:24.482940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.503246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.534311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.550157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8d2d-8fbd-4f78-b3b4-649f90ecf21d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.579650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d1831-343f-490e-b165-86133ad6aeea None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.583274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.583925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.584207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.584480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.585181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:24.585484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.586888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.598987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 553/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:24.604563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.613103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.613757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.614062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.614340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.615073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:24.615379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.616719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.625435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 546/1099] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:24.631548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.706750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f264098c-27ab-433e-a023-19a1d895bd9d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.720163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.727977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344edf8f-6aaf-49d9-9f2d-69f5cd22a872 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.741565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.743024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.743950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.744238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.744509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.751472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.753390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.761591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.762477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.762762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.763038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] PATH_INFO: `/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.764227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] RBAC: Authorizing `identity:get_user(user_id=3a9d3f12da394c04b5e6ce92f3fd817c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.765637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.767304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 547/1100] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/users/3a9d3f12da394c04b5e6ce92f3fd817c => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:29:24.768537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:24.769636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:24.770810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 554/1101] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:29:24.773469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.775193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.873054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93717223-aeb5-4499-8e5b-249587371924 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.874784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebae3-2626-4d16-b43a-77178d88ec68 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:24.906501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.907140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.907419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.907690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.908945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:24.909590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:24.909906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:24.910248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:24.910997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:24.911327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.912711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:24.924502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 555/1102] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:24.930333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:24.958101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.961028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:24.975739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:24.977175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:25.030849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897ea8d-b315-4a37-8e12-8fae062c0dc9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:25.063683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:25.064329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:25.065197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:25.065475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:25.066327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] RBAC: Adding query filter params (role.id=891f64d5451f4aad9c9d7f925fe4014f, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=99eac0e91e884f4c8e1c93f7f66d43a5) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:25.066635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:25.068042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:25.073731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 556/1103] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/role_assignments?user.id=99eac0e91e884f4c8e1c93f7f66d43a5&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=891f64d5451f4aad9c9d7f925fe4014f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:25.081763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 548/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:25.082913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:25.181466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:25.187415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c37d5-9926-43d7-bff4-7dd740ce9a84 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:25.223487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:25.224266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:25.224548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:25.224821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:25.226029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:25.227436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f352ff-400a-492f-b9c7-b2bfb25114f4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:25.229132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 557/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:25 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:25.235204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:25.319599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:25.338066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b02cb4-b7d6-4ccb-a2d4-ebfc21f86023 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:25.374501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:25.375156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:25.375438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:25.375709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:25.376535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0, user.id=3a9d3f12da394c04b5e6ce92f3fd817c) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:25.376844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:25.378338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4c8e7-bc2d-41c0-879b-bf628c3dce8d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:25.384293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 549/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:25 2022] GET /identity/v3/role_assignments?user.id=3a9d3f12da394c04b5e6ce92f3fd817c&scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:27.410954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b76f8-7a12-441f-9d6f-22593c2369de None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:27.411475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b76f8-7a12-441f-9d6f-22593c2369de None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:27.411586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b76f8-7a12-441f-9d6f-22593c2369de None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:27.412881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 558/1107] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:27.418216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:27.418612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:27.418780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:27.435626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:27.436808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:27.502625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 550/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:27.526984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b76f8-7a12-441f-9d6f-22593c2369de None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:27.625533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b76f8-7a12-441f-9d6f-22593c2369de None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:27.657395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:27.658711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:27.658993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:27.659273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:27.660433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:27.661909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b590c1f-a30c-4268-a25f-6db919f925f2 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:27.663454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 559/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:27.669020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:27.742900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:27.764558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313630-8cd5-4fc6-93dc-7dba5fee615b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:27.797681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:27.798376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:27.798663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:27.799493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:27.800196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:27.801611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae36131-11e0-491e-a1d5-06a809aade70 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:27.884815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 551/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:29:27 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:29.943214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be5e86-177c-4953-ba09-5523a142b52a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:29.943739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be5e86-177c-4953-ba09-5523a142b52a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:29.943834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be5e86-177c-4953-ba09-5523a142b52a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:29.945140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 560/1111] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:29.950362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041b49-2565-476f-a996-968fffa8de7f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:29.950750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041b49-2565-476f-a996-968fffa8de7f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:29.950917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09041b49-2565-476f-a996-968fffa8de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:29.967760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-09041b49-2565-476f-a996-968fffa8de7f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:29.968920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-09041b49-2565-476f-a996-968fffa8de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:30.033149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 552/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:30.056605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be5e86-177c-4953-ba09-5523a142b52a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:30.087621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:30.155712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be5e86-177c-4953-ba09-5523a142b52a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:30.188544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:30.189891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:30.190173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:30.190442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] PATH_INFO: `/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:30.191899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] RBAC: Authorizing `identity:get_role(role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:30.193296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:30.194633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 561/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:30 2022] GET /identity/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:30.200224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041b49-2565-476f-a996-968fffa8de7f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:30.260077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:30.297004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09041b49-2565-476f-a996-968fffa8de7f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:30.331224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:30.332087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:30.332369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:30.332638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] PATH_INFO: `/v3/users/044b6d2620c543308dbc6019287e735c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:30.344920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] RBAC: Authorizing `identity:get_user(user_id=044b6d2620c543308dbc6019287e735c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:30.346409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:30.348216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 553/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:30 2022] GET /identity/v3/users/044b6d2620c543308dbc6019287e735c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:30.353746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:30.447855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:30.450729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054b7cc-16b9-481e-beeb-a5357bb7b5ba None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:30.482990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:30.483623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:30.483904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:30.484179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:30.549372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:30.550832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:30.641486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:30.644911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 562/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:30.650822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:30.746916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d20c0-b262-45e8-b714-f52da8fda70a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:30.765347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:30.778503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:30.779333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:30.779610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:30.779878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:30.781032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:30.782480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2064c74-e1ca-4689-800a-885e07964606 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:30.784651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 554/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:30 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:30.790517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:30.892523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2849289b-1daf-4e96-bfc5-7043b9a46b50 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:30.925660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:30.926320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:30.926609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:30.926885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:30.927701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0, user.id=044b6d2620c543308dbc6019287e735c) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:30.928013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:30.929407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e631a-b784-4d02-a2eb-d5401af3bf50 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:30.934731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 563/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:30 2022] GET /identity/v3/role_assignments?user.id=044b6d2620c543308dbc6019287e735c&scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:32.917976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770475-5f32-462d-a70a-a785c904ba90 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:32.918564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770475-5f32-462d-a70a-a785c904ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:32.918564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770475-5f32-462d-a70a-a785c904ba90 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:32.919912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 555/1118] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:32.925723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:32.926144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:32.926325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:32.942519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:32.943687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:33.003626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:33.011783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 564/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:33.035748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770475-5f32-462d-a70a-a785c904ba90 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:33.135637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770475-5f32-462d-a70a-a785c904ba90 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:33.167687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:33.168571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:33.168805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:33.169080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] PATH_INFO: `/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:33.170563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] RBAC: Authorizing `identity:get_role(role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:33.171942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:33.173278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 556/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:33 2022] GET /identity/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:33.179454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:33.279366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf91322-00d2-433a-8ea7-2e9bf2880c1a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:33.311911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:33.312767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:33.313052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:33.313332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] PATH_INFO: `/v3/users/044b6d2620c543308dbc6019287e735c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:33.314539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] RBAC: Authorizing `identity:get_user(user_id=044b6d2620c543308dbc6019287e735c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:33.315962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:33.317568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 565/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:33 2022] GET /identity/v3/users/044b6d2620c543308dbc6019287e735c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:33.323399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:33.378175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:33.420624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec8797-8989-4596-a295-c69f4c52ce2b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:33.452048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:33.452889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:33.453167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:33.453441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:33.455172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:33.456574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56044346-f38a-49f8-a8a3-db5db269181c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:33.458264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 557/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:33 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:33.464877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:33.525525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:33.563320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab01ddd-abff-4400-8646-29e48e1733d6 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:33.596432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:33.597299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:33.597578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:33.597875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0/users/044b6d2620c543308dbc6019287e735c/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:33.600052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] RBAC: Authorizing `identity:create_grant(project_id=a331204dd32d45ebb4fd7b1f21763bb0, user_id=044b6d2620c543308dbc6019287e735c, role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:33.601471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2958-f1a8-4ad7-820e-0d786fba8499 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:33.703663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 566/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:29:33 2022] PUT /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0/users/044b6d2620c543308dbc6019287e735c/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:29:35.679042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3a14-b084-4efc-b890-960b72211052 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:35.679591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3a14-b084-4efc-b890-960b72211052 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:35.679591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3a14-b084-4efc-b890-960b72211052 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:35.680958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 558/1124] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:35.686073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:35.686486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:35.686632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:35.703438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:35.704659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:35.769305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 567/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:35.792410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3a14-b084-4efc-b890-960b72211052 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:35.892119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3a14-b084-4efc-b890-960b72211052 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:35.914464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:35.925234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] PATH_INFO: `/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] RBAC: Authorizing `identity:get_role(role_id=0f05cae1581243a5ac739a9b96c3fbbf)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:35.931913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 559/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:35 2022] GET /identity/v3/roles/0f05cae1581243a5ac739a9b96c3fbbf => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:35.936428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:35.985665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:36.030959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e64155-ea85-4a5d-a818-11d10d5d3c61 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:36.064601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:36.065458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:36.065738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:36.066039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] PATH_INFO: `/v3/users/044b6d2620c543308dbc6019287e735c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:36.067204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] RBAC: Authorizing `identity:get_user(user_id=044b6d2620c543308dbc6019287e735c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:36.068612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:36.070259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 568/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:35 2022] GET /identity/v3/users/044b6d2620c543308dbc6019287e735c => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:36.075987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:36.171685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee8e6c-7de7-49ed-9b04-4cd4ce5a3d0f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:36.203980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:36.205074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:36.205356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:36.205629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:36.261231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:36.270637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:36.273595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:36.370336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 560/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:36.376273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:36.472054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08226e2a-3861-4e8b-a66e-cac4fe0086c7 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:36.490954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:36.504400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:36.505239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:36.505518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:36.505788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] PATH_INFO: `/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:36.511101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] RBAC: Authorizing `identity:get_project(project_id=a331204dd32d45ebb4fd7b1f21763bb0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:36.511101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb572-9a38-46bf-adbb-59c20d138c5e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:36.511101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 569/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:36 2022] GET /identity/v3/projects/a331204dd32d45ebb4fd7b1f21763bb0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:36.515958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:36.605117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:36.613533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97719-5fe0-4a36-b217-9f49fa3b579c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:36.647612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:36.648257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:36.648544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:36.648820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:36.649639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] RBAC: Adding query filter params (role.id=0f05cae1581243a5ac739a9b96c3fbbf, scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0, user.id=044b6d2620c543308dbc6019287e735c) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:36.649983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:36.651399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c2448-774b-4a66-955a-e441b27aaa2f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:36.657118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 561/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:36 2022] GET /identity/v3/role_assignments?user.id=044b6d2620c543308dbc6019287e735c&scope.project.id=a331204dd32d45ebb4fd7b1f21763bb0&role.id=0f05cae1581243a5ac739a9b96c3fbbf => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:38.685056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995b07-bfd2-4ad6-a03b-dea2a62d486e None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:38.685609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995b07-bfd2-4ad6-a03b-dea2a62d486e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:38.685609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3995b07-bfd2-4ad6-a03b-dea2a62d486e None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:38.687037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 570/1131] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:38.692209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:38.692622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:38.692759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:38.710242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:38.711417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:38.775674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 562/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:38.798946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3995b07-bfd2-4ad6-a03b-dea2a62d486e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:38.896891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3995b07-bfd2-4ad6-a03b-dea2a62d486e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:38.928495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:38.929259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:38.929542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:38.929814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:38.930994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:38.932404 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341282b0-85bb-443e-8ca0-d6085d6ab043 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:38.934140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 571/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:38.940318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:39.022291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:39.036383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cc4b7-53aa-4449-873d-a152c011e4fd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:39.069282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:39.069954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:39.070238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:39.070511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:39.071215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:39.072633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dbfd9-4f4f-42b9-b8cb-a39bdc116a2e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:39.138928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 563/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:29:38 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:29:41.158698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180421fc-0865-4848-ab9e-ebb331b62206 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:41.159206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180421fc-0865-4848-ab9e-ebb331b62206 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:41.159295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180421fc-0865-4848-ab9e-ebb331b62206 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:41.160596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 572/1135] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:41.165876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:41.166280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:41.166447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:41.183582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:41.184771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:41.250225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 564/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:41.274931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180421fc-0865-4848-ab9e-ebb331b62206 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:41.330467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:41.374134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180421fc-0865-4848-ab9e-ebb331b62206 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:41.406665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:41.407947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:41.408227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:41.408499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:41.409654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:41.411083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad8dc4f-a9f3-4100-bba0-812187571f05 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:41.412659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 573/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:29:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:41.418335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:41.482945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:41.515875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678210ff-13c9-4ef2-a88d-c2dacb516885 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:41.552107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:41.552769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:41.553052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:41.553327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:41.554057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:41.555482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb25d-b0d0-4418-b953-0007a65845e2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:41.618733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 565/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:29:41 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:43.652334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef7bc-6990-4d1e-9f14-2ce7745d8ed9 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:43.652884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef7bc-6990-4d1e-9f14-2ce7745d8ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:43.652884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aef7bc-6990-4d1e-9f14-2ce7745d8ed9 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:43.654295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 574/1139] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:43.659460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:43.659850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:43.660011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:43.676377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:43.677556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:43.743387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 566/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:43.767076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef7bc-6990-4d1e-9f14-2ce7745d8ed9 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:43.867166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aef7bc-6990-4d1e-9f14-2ce7745d8ed9 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:43.890202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:43.900547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:43.907768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:43.907768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:43.907768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:43.911696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:43.919315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:43.920444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:43.921743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 575/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:43.926973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:43.979542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:44.022864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d67d37-f92f-47c9-94d3-1760030f6e1a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:44.055778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:44.056436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:44.056719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:44.056996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:44.057732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:44.058065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:44.059419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:44.067806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 567/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:44.073478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:44.169993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc95321-de49-444f-af9e-9e8d2abf92cb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:44.201794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:44.205252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:44.205252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:44.205252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] PATH_INFO: `/v3/users/d72e6855586240cda9d95d8c64ecadbc` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:44.215967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] RBAC: Authorizing `identity:get_user(user_id=d72e6855586240cda9d95d8c64ecadbc)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:44.217460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:44.219298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 576/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:44 2022] GET /identity/v3/users/d72e6855586240cda9d95d8c64ecadbc => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:44.225529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:44.323753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ada37-6517-470e-b789-9baf2dc1bf6c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:44.339416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:44.356924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:44.357564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:44.357865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:44.358156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:44.424030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:44.425409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:44.519135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 568/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:44.524954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:44.566751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:44.621930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b437b2-9588-4804-b584-17881d6d2c3b None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:44.655345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78676752-8685-4d6e-8912-202088639c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:44.656186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676752-8685-4d6e-8912-202088639c10 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:44.656467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676752-8685-4d6e-8912-202088639c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:44.656742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78676752-8685-4d6e-8912-202088639c10 None admin] PATH_INFO: `/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:44.658616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78676752-8685-4d6e-8912-202088639c10 None admin] RBAC: Authorizing `identity:get_project(project_id=158f22f89ae84d29b2e6c7235ee4ea59)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:44.660049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78676752-8685-4d6e-8912-202088639c10 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:44.661775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 577/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:44 2022] GET /identity/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:44.667941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:44.685175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:44.763132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa32f740-fa8e-44e9-8f77-37d06f43e0db None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:44.796056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:44.796690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:44.796970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:44.797245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:44.798110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=158f22f89ae84d29b2e6c7235ee4ea59, user.id=d72e6855586240cda9d95d8c64ecadbc) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:44.798420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:44.799830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee9527-af49-4c23-9bd2-ea2966e89cc5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:44.805061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 569/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:44 2022] GET /identity/v3/role_assignments?user.id=d72e6855586240cda9d95d8c64ecadbc&scope.project.id=158f22f89ae84d29b2e6c7235ee4ea59&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:46.784552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864c8e-1935-4db8-9178-4fb26ce9f512 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:46.785076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864c8e-1935-4db8-9178-4fb26ce9f512 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:46.785076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2864c8e-1935-4db8-9178-4fb26ce9f512 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:46.786514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 578/1147] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:46.791733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:46.792154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:46.792279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:46.809084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:46.810285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:46.878030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 570/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:46.900257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864c8e-1935-4db8-9178-4fb26ce9f512 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:46.998690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2864c8e-1935-4db8-9178-4fb26ce9f512 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:47.009509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:47.032141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:47.032924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:47.033212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:47.033490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:47.043361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:47.051926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:47.052834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:47.053650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 579/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:47.059460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:47.071406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:47.154840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8794d-90a3-4012-b5fe-fb623afc7ea4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:47.187702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:47.188391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:47.188670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:47.188943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:47.189677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:47.190083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:47.191432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:47.199176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 571/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:47.204808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:47.302521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf522bc1-1057-4252-9e9e-8a862d3003da None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:47.334487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:47.335329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:47.335610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:47.335883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] PATH_INFO: `/v3/users/d72e6855586240cda9d95d8c64ecadbc` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:47.337054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] RBAC: Authorizing `identity:get_user(user_id=d72e6855586240cda9d95d8c64ecadbc)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:47.338500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:47.340108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 580/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:47 2022] GET /identity/v3/users/d72e6855586240cda9d95d8c64ecadbc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:47.346202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:47.413916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:47.443021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807de5a-3476-4200-b305-535c4dbc273e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:47.476631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:47.477463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:47.477741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:47.478046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] PATH_INFO: `/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:47.479203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] RBAC: Authorizing `identity:get_project(project_id=158f22f89ae84d29b2e6c7235ee4ea59)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:47.480600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62332f39-14e2-4262-b267-16dd98e3b06c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:47.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 572/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:47 2022] GET /identity/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:47.487994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:47.527472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:47.585356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83dd76-3f24-47be-934c-c8b0bfb9dd3d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:47.618242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:47.619109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:47.619391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:47.619664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] PATH_INFO: `/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59/users/d72e6855586240cda9d95d8c64ecadbc/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:47.621603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=158f22f89ae84d29b2e6c7235ee4ea59, user_id=d72e6855586240cda9d95d8c64ecadbc, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:47.623043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80678b-99e6-47cf-9cda-768639ab52e4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:47.703304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 581/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:29:47 2022] PUT /identity/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59/users/d72e6855586240cda9d95d8c64ecadbc/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:29:49.681803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa31c6-2498-4d37-af1c-cf7bae259f92 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:49.682352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa31c6-2498-4d37-af1c-cf7bae259f92 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:49.682462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fa31c6-2498-4d37-af1c-cf7bae259f92 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:49.683755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 573/1154] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:49.688826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:49.689197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:49.689380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:49.706272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:49.707441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:49.772332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 582/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:49.795899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa31c6-2498-4d37-af1c-cf7bae259f92 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:49.896238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fa31c6-2498-4d37-af1c-cf7bae259f92 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:49.928619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:49.929393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:49.929674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:49.929974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:49.937332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:49.941204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:29:49.948657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:49.949738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:29:49.950668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 574/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:49.955844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:49.982430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:50.052056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee474aa-45ec-47f4-a879-9544d932aa3b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:50.084927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:50.085583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:50.085889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:50.086171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:50.086910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:50.087220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:50.088570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:50.096863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 583/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:50.102732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:50.199147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376662b-92ba-4aa6-8e49-c6809f68422e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:50.232109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:50.232955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:50.233241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:50.233517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] PATH_INFO: `/v3/users/d72e6855586240cda9d95d8c64ecadbc` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:50.235368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=d72e6855586240cda9d95d8c64ecadbc)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:50.236788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:50.238429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 575/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:29:50 2022] GET /identity/v3/users/d72e6855586240cda9d95d8c64ecadbc => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:50.244320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:50.331492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:50.340695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df65137-d883-4f80-ae5a-9860d9794d18 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:50.374774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:50.375430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:50.375717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:50.375996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:50.440411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:50.441836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:50.527384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:50.537562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 584/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:50.543885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:50.607949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:50.639158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08c940-847f-4a27-b600-2d1504436ba0 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:50.672435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:50.673271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:50.673552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:50.673828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] PATH_INFO: `/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:50.675023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] RBAC: Authorizing `identity:get_project(project_id=158f22f89ae84d29b2e6c7235ee4ea59)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:50.676433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110fee4c-631d-47e4-a73a-2003e26dc202 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:50.678126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 576/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:29:50 2022] GET /identity/v3/projects/158f22f89ae84d29b2e6c7235ee4ea59 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:50.683994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:50.779422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee0013-d098-4c7e-91b6-44c13c6934a1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:50.811888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:50.812529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:50.812815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:50.813119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:50.813960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=158f22f89ae84d29b2e6c7235ee4ea59, user.id=d72e6855586240cda9d95d8c64ecadbc) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:50.814274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:50.815677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae33ac2-a331-43ed-8168-f79a41a554ad None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:50.821300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 585/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:29:50 2022] GET /identity/v3/role_assignments?user.id=d72e6855586240cda9d95d8c64ecadbc&scope.project.id=158f22f89ae84d29b2e6c7235ee4ea59&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:29:52.847851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5156bc-af53-4d88-9712-729948de14f6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:52.885147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5156bc-af53-4d88-9712-729948de14f6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:52.885147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5156bc-af53-4d88-9712-729948de14f6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:52.885147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 577/1162] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:52.885428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:52.885428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:52.885428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:52.885428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:52.885428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:52.920827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:52.937268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 586/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:52.960115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5156bc-af53-4d88-9712-729948de14f6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:53.061116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5156bc-af53-4d88-9712-729948de14f6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:53.094742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:53.095384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:53.095668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:53.095941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:53.099379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:53.161196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:53.162647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:53.258234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 578/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:29:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:29:53.264214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:53.359300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7217e0-da68-4744-a4f5-725acfc35fe7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:53.392306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:53.393089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:53.393372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:53.393645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:53.400070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:53.401468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-7c540d1a-4beb-42cd-a346-8dc3a9572779 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:29:53.415096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:29:53.416326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:29:53.417425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 587/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:29:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:29:53.422041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:53.455907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:53.518342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9919183-b77f-4519-a845-0113b18b7610 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:53.550984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:53.551632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:53.551916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:53.552196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:53.552916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:29:53.553225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:53.554595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c2f81-4148-4011-afc7-3005c52a3608 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:53.561564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 579/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Fri Jun 24 03:29:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:55.546164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf3e7-3d07-49dc-b21b-7543b573fc45 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:55.546711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf3e7-3d07-49dc-b21b-7543b573fc45 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:55.546711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaf3e7-3d07-49dc-b21b-7543b573fc45 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:55.548694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 588/1167] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:55.553904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040a35-7db3-45b5-859e-62ff06589261 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:55.554299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040a35-7db3-45b5-859e-62ff06589261 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:55.554468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52040a35-7db3-45b5-859e-62ff06589261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:55.570693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-52040a35-7db3-45b5-859e-62ff06589261 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:55.571869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-52040a35-7db3-45b5-859e-62ff06589261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:55.636407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 580/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:55.661225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaf3e7-3d07-49dc-b21b-7543b573fc45 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:55.707252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:55.760761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaf3e7-3d07-49dc-b21b-7543b573fc45 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:55.793394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:55.794049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:55.794332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:55.794603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:55.795334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:55.796720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f94c3-18ed-46fc-b822-1ce9fbc12c9c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:55.847885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 589/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Fri Jun 24 03:29:55 2022] POST /identity/v3/domains => generated 267 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:29:57.866985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efae5-46db-4042-b48e-98d97f61b0e6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:57.867514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efae5-46db-4042-b48e-98d97f61b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:57.867606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efae5-46db-4042-b48e-98d97f61b0e6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:57.868936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 581/1170] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:29:57.874169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:57.874555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:57.874732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:57.890987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:29:57.892165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:29:57.956827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 590/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:29:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:29:57.980474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efae5-46db-4042-b48e-98d97f61b0e6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:58.011433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:58.080350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efae5-46db-4042-b48e-98d97f61b0e6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:58.112918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:58.113767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:58.114096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:58.114370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] PATH_INFO: `/v3/domains/61e702ec01584309aa08b42135d91bdd` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:58.124816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=61e702ec01584309aa08b42135d91bdd)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:58.126771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a515e0-233c-45dc-aacd-80e1bc724747 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:58.128394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 582/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 03:29:57 2022] GET /identity/v3/domains/61e702ec01584309aa08b42135d91bdd => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:29:58.134166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:29:58.166279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:29:58.231186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192fa4d-56a8-4048-8169-308db3978d94 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:29:58.265521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:29:58.266198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:29:58.266482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:29:58.266756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:29:58.267463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:29:58.268911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f78169-4bc4-45f0-8cd9-4b2a214318c4 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:29:58.344369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 591/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:29:58 2022] POST /identity/v3/projects => generated 361 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:30:00.360051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501438-f4fd-4bd5-9070-f12744fb3ace None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:00.360577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501438-f4fd-4bd5-9070-f12744fb3ace None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:00.360687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4501438-f4fd-4bd5-9070-f12744fb3ace None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:00.362011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 583/1174] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:30:00.367410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e120-8a54-461c-b2a5-12004177046b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:00.367842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e120-8a54-461c-b2a5-12004177046b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:00.367942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259e120-8a54-461c-b2a5-12004177046b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:00.384185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7259e120-8a54-461c-b2a5-12004177046b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:30:00.385348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7259e120-8a54-461c-b2a5-12004177046b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:30:00.448709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 592/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:30:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:30:00.474549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4501438-f4fd-4bd5-9070-f12744fb3ace None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:00.562977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:00.573113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4501438-f4fd-4bd5-9070-f12744fb3ace None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:00.606854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:00.607695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:00.607977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:00.608248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] PATH_INFO: `/v3/domains/61e702ec01584309aa08b42135d91bdd` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:00.609432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=61e702ec01584309aa08b42135d91bdd)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:00.610926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd001a-e08f-4d85-9d51-a9aa60eafc5e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:00.612476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 584/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Fri Jun 24 03:30:00 2022] GET /identity/v3/domains/61e702ec01584309aa08b42135d91bdd => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:00.618218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259e120-8a54-461c-b2a5-12004177046b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:00.635754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:00.714861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259e120-8a54-461c-b2a5-12004177046b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:00.747150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:00.747795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:00.748074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:00.748345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:00.749045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:00.751000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0f3d2-8593-4610-947a-da4097b2a335 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:00.839309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 593/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:30:00 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:30:02.879260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b46a-e073-4c83-adc7-9d32824d1668 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:02.879844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b46a-e073-4c83-adc7-9d32824d1668 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:02.879844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b46a-e073-4c83-adc7-9d32824d1668 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:02.881178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 585/1178] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:30:02.886421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:02.886838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:02.886984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:02.903435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:30:02.904621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:30:02.969998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 594/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:30:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:30:02.994322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b46a-e073-4c83-adc7-9d32824d1668 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.091391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b46a-e073-4c83-adc7-9d32824d1668 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:03.124458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:03.125266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:03.125546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:03.125815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:03.135603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:30:03.143270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:30:03.144432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:30:03.145578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 586/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:30:03.150380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.152552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:03.249143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8db6d2-9bdf-4fd0-bee4-cc6f9e3c322f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:03.282302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:03.282959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:03.283243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:03.283526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:03.284265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:30:03.284574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:03.285957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:03.293744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 595/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:30:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:03.299498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.318915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:03.396521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edf78-9510-46bd-b66f-f19ef85d1ab7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:03.428950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:03.429808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:03.430121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:03.430397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] PATH_INFO: `/v3/users/0f0391d92876404fb25aca0b8526b57c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:03.443120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=0f0391d92876404fb25aca0b8526b57c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:03.444551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:03.446221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 587/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:30:03 2022] GET /identity/v3/users/0f0391d92876404fb25aca0b8526b57c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:03.451979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.512492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:03.550668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d86c25-f6c7-4a8e-9b65-95650d5a099e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:03.582990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:03.583620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:03.583904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:03.584180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:03.649715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:03.651114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:03.709361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:03.745992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 596/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:30:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:30:03.752230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.826255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:03.848416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71defffa-182e-4813-a92a-e4f226614fc4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:03.881875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:03.882727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:03.883010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:03.883283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] PATH_INFO: `/v3/projects/f2487e7876b042ce962edd515684a5a3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:03.884462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] RBAC: Authorizing `identity:get_project(project_id=f2487e7876b042ce962edd515684a5a3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:03.885898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace0ecc-91ec-49de-84a1-1eca85da1982 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:03.887574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 588/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:30:03 2022] GET /identity/v3/projects/f2487e7876b042ce962edd515684a5a3 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:03.893977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:03.988892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aad350-d59b-416b-8bee-453f64537e26 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:04.022663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:04.023308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:04.023593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:04.023870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:04.024685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=f2487e7876b042ce962edd515684a5a3, user.id=0f0391d92876404fb25aca0b8526b57c) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:30:04.024998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:04.026436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39d179-29d0-44f4-9250-e8ee4bd80fa8 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:04.031727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 597/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:30:03 2022] GET /identity/v3/role_assignments?user.id=0f0391d92876404fb25aca0b8526b57c&scope.project.id=f2487e7876b042ce962edd515684a5a3&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:06.025810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d166b-ff65-4940-b736-35e54f128748 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.026280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d166b-ff65-4940-b736-35e54f128748 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.026372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d166b-ff65-4940-b736-35e54f128748 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.027755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 589/1186] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:30:06.033361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.033730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.033967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.050971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:30:06.052168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:30:06.074203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:06.117211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 598/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:30:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:30:06.139683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d166b-ff65-4940-b736-35e54f128748 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:06.238267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d166b-ff65-4940-b736-35e54f128748 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:06.271435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:06.272154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.272437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.272712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.283127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:30:06.290625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:30:06.291687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:30:06.292900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 590/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:30:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:30:06.297665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:06.392292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82627b4-e5b9-4db5-91ef-6656486846ce None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:06.425041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:06.425703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.426030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.426308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.427049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:30:06.427360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:06.428710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:06.436494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 599/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:30:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:06.442157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:06.445824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:06.542255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a02654-32b9-43ef-bcb7-4ddabb49d548 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:06.574022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:06.574885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.575169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.575442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] PATH_INFO: `/v3/users/0f0391d92876404fb25aca0b8526b57c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.576610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] RBAC: Authorizing `identity:get_user(user_id=0f0391d92876404fb25aca0b8526b57c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:06.578603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:06.580218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 591/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:30:06 2022] GET /identity/v3/users/0f0391d92876404fb25aca0b8526b57c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:06.585933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:06.608153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:06.683100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9a16-4903-4cc7-8d74-56c14698ef3e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:06.717094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:06.717968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.718283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.718561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] PATH_INFO: `/v3/projects/f2487e7876b042ce962edd515684a5a3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.719726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] RBAC: Authorizing `identity:get_project(project_id=f2487e7876b042ce962edd515684a5a3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:06.721143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed4f5b-c1c0-4cc4-bdd3-8a9f45f5d547 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:06.722850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 600/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:30:06 2022] GET /identity/v3/projects/f2487e7876b042ce962edd515684a5a3 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:06.728572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:06.811352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:06.840528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ab06d-1327-415a-b0d9-ed04a8c4c85a None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:06.873163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:06.874056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:06.874833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:06.875113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] PATH_INFO: `/v3/projects/f2487e7876b042ce962edd515684a5a3/users/0f0391d92876404fb25aca0b8526b57c/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:06.877034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] RBAC: Authorizing `identity:create_grant(project_id=f2487e7876b042ce962edd515684a5a3, user_id=0f0391d92876404fb25aca0b8526b57c, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:06.878487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee11a4b-b454-4501-861a-e55e9bc9b7ec None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:06.942864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 592/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:30:06 2022] PUT /identity/v3/projects/f2487e7876b042ce962edd515684a5a3/users/0f0391d92876404fb25aca0b8526b57c/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:30:08.917133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7db7a-c6a8-4a64-8110-0c39ce09484d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:08.917660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7db7a-c6a8-4a64-8110-0c39ce09484d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:08.917660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a7db7a-c6a8-4a64-8110-0c39ce09484d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:08.919092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 601/1193] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:30:08.924710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:08.925087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:08.925269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:08.941537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:30:08.942736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:30:09.007768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 593/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:30:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:30:09.031518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7db7a-c6a8-4a64-8110-0c39ce09484d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.117463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:09.129885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a7db7a-c6a8-4a64-8110-0c39ce09484d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:09.163221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:09.164008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:09.164321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:09.164596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:09.175298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:30:09.182894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:30:09.183979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:30:09.185023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 602/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:30:09.190219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.250394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:09.288339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e990f9-69e0-4e86-8633-b9d3da470833 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:09.320954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:09.321601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:09.321904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:09.322178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:09.322907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:30:09.323208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:09.324552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:09.332849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 594/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:09.338602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.434996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f98d71-d671-4786-94c9-610ea49ad350 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:09.467169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:09.468581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:09.468869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:09.469147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] PATH_INFO: `/v3/users/0f0391d92876404fb25aca0b8526b57c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:09.470350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] RBAC: Authorizing `identity:get_user(user_id=0f0391d92876404fb25aca0b8526b57c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:09.471763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:09.473372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 603/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/users/0f0391d92876404fb25aca0b8526b57c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:09.478904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.574755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ae2374-c74d-4e02-9ca0-5d2384fca37b None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:09.597728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:09.607901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:09.608545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:09.609124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:09.609124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:09.685565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:09.687454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:09.781834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 595/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:30:09.787692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.805547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:09.884961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bf53b-2121-4ba1-89dc-b3a05fac7118 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:09.917558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:09.918434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:09.918716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:09.918991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] PATH_INFO: `/v3/projects/f2487e7876b042ce962edd515684a5a3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:09.920153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] RBAC: Authorizing `identity:get_project(project_id=f2487e7876b042ce962edd515684a5a3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:09.921591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15d51b-1c48-4434-98cd-4fc2a249c130 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:09.923302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 604/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/projects/f2487e7876b042ce962edd515684a5a3 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:09.929149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:30:09.953839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:10.025891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0f14d-e9cb-4632-a74d-28d96b091372 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:30:10.058567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:30:10.059212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:30:10.059498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:30:10.059773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:30:10.060597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=f2487e7876b042ce962edd515684a5a3, user.id=0f0391d92876404fb25aca0b8526b57c) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:30:10.060908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:30:10.062959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c4d86-78f2-4ebc-93a4-11995de93963 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:30:10.068656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 596/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:30:09 2022] GET /identity/v3/role_assignments?user.id=0f0391d92876404fb25aca0b8526b57c&scope.project.id=f2487e7876b042ce962edd515684a5a3&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:30:19.913521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=58 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:30:20.066097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=56 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:20.065244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025b39-7eb5-40ba-a14d-9b31668c917d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:20.065785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025b39-7eb5-40ba-a14d-9b31668c917d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:20.065785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90025b39-7eb5-40ba-a14d-9b31668c917d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:20.067253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 605/1201] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:20.072349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:20.072745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:20.072914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:20.090103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:20.092270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:20.158720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 597/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:20.183259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025b39-7eb5-40ba-a14d-9b31668c917d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:20.283624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90025b39-7eb5-40ba-a14d-9b31668c917d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:20.317095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:20.317891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:20.318222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:20.318493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:20.329102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:20.330547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:20.347661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:20.348837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:20.352726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:20.352726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:20.352726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:20.352726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:20.352726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 606/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:20.354911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:20.453711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ecc43-00a1-4839-ac22-4d43e8921f9c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:20.481056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:20.487303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:20.487995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:20.488276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:20.488549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:20.489260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:20.489562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:20.491203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a897831-5b8e-4dc5-9da9-192dd9dc810b None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:20.502809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 598/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:20.508629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:20.562044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:20.609125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889ca61-2c5d-4121-90df-90819563d0b9 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:20.642362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:20.643000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:20.643287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:20.643570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:20.644278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:20.645711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0adbbef-826e-4568-8e9d-28884c50b0cb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:20.700690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 607/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Fri Jun 24 03:31:20 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:31:22.761639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5cb07-f35e-4d38-8989-bd218b1b7317 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:22.762207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5cb07-f35e-4d38-8989-bd218b1b7317 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:22.762310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5cb07-f35e-4d38-8989-bd218b1b7317 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:22.764165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 599/1206] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:22.769947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:22.770501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:22.770501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:22.787489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:22.788681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:22.854508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 608/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:22.878188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5cb07-f35e-4d38-8989-bd218b1b7317 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:22.979726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5cb07-f35e-4d38-8989-bd218b1b7317 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.013090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.014356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.014637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.014906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.025421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:23.033626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:23.034814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:23.035897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 600/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:31:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:23.040833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.082512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:23.139494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91dde3-2f11-4ad4-9f8f-26af517432a4 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.173019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.173680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.173993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.174271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.175007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:23.175319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:23.176698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:23.184290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 609/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:23.190700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.239717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:23.287710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91a544-3b72-4898-99fd-d5032971c101 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.320892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.321670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.322008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.322251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.332535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:23.333986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:23.350971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:23.351976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:23.352906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:23.352906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:23.352906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:23.352906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:23.352906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 601/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:23.358119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.454238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:23.457036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8a7b0-bc36-4b68-b1d5-188f1ab9a84f None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.489917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.490568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.491119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.491405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.492113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:23.492419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:23.493831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:23.505673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 610/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:23.511311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.609801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe1dc1-6e24-41a2-9d79-181c5d1d9842 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.611339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:23.642753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.643550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.643813 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.644091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.651399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:23.652814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:23.667024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:23.668161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:23.669391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 602/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:23.674427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.773035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90af37-ffa3-47b2-8cce-682b9bdef5b3 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.807093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.807758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.808043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.808316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.809150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:23.809458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:23.810921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:23.827857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 611/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:23.833714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:23.935198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adcde38-9e13-46a5-afc8-ecf5885a649c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:23.967862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:23.968501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:23.968786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:23.969062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:23.999122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.035691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.037126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.134468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 603/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:31:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:31:24.141011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:24.160320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.237049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a955e-849e-422f-9862-537128918b84 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:24.271621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:24.272414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:24.272695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:24.273013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:24.283975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.285390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:24.302331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:24.305551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:24.306725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:24.306725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:24.306725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:24.306725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:24.306725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 612/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:24.309396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:24.371457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.408802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33949a51-7632-4fa0-bdee-77601fce0eed None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:24.442269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:24.442926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:24.443299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:24.443572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:24.444289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:24.444602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.445965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.457407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 604/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:24.463104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:24.531491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.561133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f4d7a-c296-40bb-8802-fda30b6a4deb None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:24.594339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:24.595122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:24.595402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:24.595673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:24.602515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.603943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:24.618181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:24.619321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:24.620210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 613/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:24.625910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:24.723714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5797e-076a-445c-a98e-5ef8e4f374a4 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:24.746012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.758371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:24.759182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:24.759561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:24.759970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:24.760845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:24.761240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.762879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe0ba-2ae6-48a3-9ba5-bbb574312a35 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.775407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 605/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:24.786297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:24.884755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de194aa0-c0bf-4769-90e0-6b19b7605c6e None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:24.913111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:24.918956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:24.920116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:24.920399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:24.920675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:24.921528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=e33b3d4866d04b0095739952e76255c4) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:24.921913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:24.923333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5568b-2c5b-436a-946a-f1fa7498ca50 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:24.928694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 614/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:31:24 2022] GET /identity/v3/role_assignments?user.id=e33b3d4866d04b0095739952e76255c4&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:26.919212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef169e4-83b0-4752-b16b-c42b06b8d0be None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:26.919766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef169e4-83b0-4752-b16b-c42b06b8d0be None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:26.919766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef169e4-83b0-4752-b16b-c42b06b8d0be None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:26.921288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 606/1220] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:26.926435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:26.926852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:26.927002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:26.944019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:26.945201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:27.011575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 615/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:27.035155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef169e4-83b0-4752-b16b-c42b06b8d0be None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.135771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef169e4-83b0-4752-b16b-c42b06b8d0be None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.169914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.170656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.170939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.171210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.181125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:27.189349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:27.190453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:27.191371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 607/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:27.196934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.294130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29c2f5-a39a-4195-ae1e-8cbe193e7c44 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.317793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:27.328331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.328974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.329247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.329521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.330364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] RBAC: Adding query filter params (name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:27.330676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:27.337057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:27.339768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 616/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:31:27.345492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.390190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:27.447774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886732c-c080-4ab7-a1eb-1401f33934e5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.480759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.481544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.482333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.482632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.493459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:27.494965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:27.512202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:27.513283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:27.514247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:27.514247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:27.514247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:27.514247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:27.514247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 608/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:27.519199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.619040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dbd12-440d-4e1a-b870-0f289cc91613 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.650985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.651632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.651911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.652181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.653007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:27.653314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:27.655221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:27.666045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 617/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:27.672337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.765806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:27.772257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001e549-0c6d-48ab-834b-d7dd55044457 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.805931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.806726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.807013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.807292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.814628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:27.816060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:27.830569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:27.831686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:27.832849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 609/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:27.837614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:27.884494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:27.935606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a4fff-2235-494a-bf74-2d8f90e1c3e1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:27.974113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:27.974784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:27.975066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:27.975339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:27.976311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:27.976622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:27.978059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:27.996190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 618/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:28.002057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:28.100890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f96792-0ad7-4145-b164-b35b8cddff9d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:28.133606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:28.134424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:28.134712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:28.134990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:28.146010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:28.147455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:28.164741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:28.171427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:28.172545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:28.172545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:28.172545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:28.172545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:28.172545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 610/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:28.172896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:28.269157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d2fb4-28e2-4a2d-967e-8aaba06f3423 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:28.271462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:28.302774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:28.303434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:28.303720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:28.303997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:28.304710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:28.305019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:28.306411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:28.318018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 619/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:28.323735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:28.333720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:28.423140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c826-fa5c-4066-acb0-44204e402612 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:28.457039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:28.457828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:28.458149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:28.458431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:28.465565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:28.467127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:28.481101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:28.482284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:28.483302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 611/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:28.488107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:28.585866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532addd8-8fc6-47b8-bdf8-c5fcbf72663c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:28.618104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:28.618747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:28.619029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:28.619305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:28.620074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:28.620384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:28.621871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71d9bf-2ae6-449d-9b4a-a417b4107336 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:28.633919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 620/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:28.640573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:28.705742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:28.739057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555ec25-d1f9-4ed3-88f7-eaa1266cf659 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:28.772681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:28.773683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:28.773999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:28.774275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/e33b3d4866d04b0095739952e76255c4/roles/810e3981e9864c21b8c482b505113f6e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:28.787945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=e33b3d4866d04b0095739952e76255c4, role_id=810e3981e9864c21b8c482b505113f6e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:28.789360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca4115-d151-45e8-809c-c66d8804a1c6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:28.894895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 612/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:31:28 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/e33b3d4866d04b0095739952e76255c4/roles/810e3981e9864c21b8c482b505113f6e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:31:30.916525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8272-6725-4c18-9830-76ec5a985536 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:30.917084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8272-6725-4c18-9830-76ec5a985536 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:30.917084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b8272-6725-4c18-9830-76ec5a985536 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:30.918555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 621/1233] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:30.924100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:30.924497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:30.924650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:30.941259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:30.944696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:31.010193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 613/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:31.035787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8272-6725-4c18-9830-76ec5a985536 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.061820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:31.140536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b8272-6725-4c18-9830-76ec5a985536 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.173600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.174390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.174671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.180396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.185576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:31.193082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:31.194165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:31.195115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 622/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:31.200182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.246049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:31.300359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f850c-61a9-4e8b-b893-0a768947b7fa None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.332338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.333012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.333308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.333775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.334739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:31.335098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:31.337010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:31.345352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 614/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:31.351299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.435400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:31.450936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6f5e5-af2d-4adb-8653-a204fe106b31 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.484885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.485658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.485971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.486248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.496009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:31.497490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:31.514084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:31.515125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:31.516224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:31.516224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:31.516224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:31.516224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:31.516224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 623/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:31.521080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.619632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016e6ea-17a3-4d24-a787-d0c9f1db84f1 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.628298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:31.652460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.653111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.653394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.654235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.654961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:31.655266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:31.656623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:31.668072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 615/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:31.673781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.771019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601b8322-b2fc-48a4-84ae-81c52c532682 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.804381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.805980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.805980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.805980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.808517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:31.812931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:31.814460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:31.829118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:31.830069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:31.831017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 624/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:31:31.836076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:31.933068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a73905-94e6-4ddd-acf6-43a59de2d548 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:31.967983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:31.968652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:31.968978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:31.969395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:31.970473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:31.970790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:31.972662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:31.990304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 616/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:31.996356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:32.093963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9665697c-d1da-4123-8cfc-144ca92a7bb0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:32.128172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:32.128849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:32.129138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:32.129510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:32.190870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:32.197223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:32.198709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:32.295338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 625/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:31:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:31:32.301215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:32.329328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:32.399664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bd2984-3fcd-4a92-8fa2-14b92d89c7bc None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:32.434657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:32.435974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:32.436256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:32.436561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:32.446540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:32.448178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:32.465649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:32.466722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:32.467836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:32.467836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:32.467836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:32.467836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:32.467836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 617/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:32.472637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:32.566179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:32.571827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed68a0f-ef48-49be-b02a-71fc3e220a92 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:32.603903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:32.604554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:32.604838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:32.605114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:32.605822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:32.606164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:32.608056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:32.619183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 626/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:32.625392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:32.702358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:32.722527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80b750-1bc1-4bb0-b214-9f8f0210fe61 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:32.755726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:32.756502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:32.756785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:32.757060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:32.763588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:32.765014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:32.778306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:32.779880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:32.781008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 618/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:32.785840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:32.884936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc3815-bbf4-49dd-be25-24f965ae01e0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:32.917704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:32.918382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:32.918669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:32.918946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:32.920327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:32.920640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:32.922119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf7d3d-32f0-408b-a18e-0f3501ba2848 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:32.933740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 627/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:31:32.939851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:33.039547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cb94c-539e-4d17-affc-aa9d469d00c6 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:33.072997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:33.073647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:33.073969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:33.074249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:33.075075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] RBAC: Adding query filter params (role.id=810e3981e9864c21b8c482b505113f6e, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=e33b3d4866d04b0095739952e76255c4) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:33.075455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:33.076896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cc531-b9ec-4bfe-90bf-1f44f8b1c155 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:33.082664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 619/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:31:32 2022] GET /identity/v3/role_assignments?user.id=e33b3d4866d04b0095739952e76255c4&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=810e3981e9864c21b8c482b505113f6e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:35.168496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bfd6-064c-4a64-8685-2363259ca918 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.169108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bfd6-064c-4a64-8685-2363259ca918 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.169108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276bfd6-064c-4a64-8685-2363259ca918 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.170498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 628/1247] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:35.175838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.177872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.177872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.181403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:35.193796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:35.194996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:35.261420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 620/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:35.285576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276bfd6-064c-4a64-8685-2363259ca918 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:35.303673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:35.385244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276bfd6-064c-4a64-8685-2363259ca918 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:35.418290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:35.419603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.419885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.420157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.430004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:35.438225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:35.439407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:35.440698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 629/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:35.445459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:35.543578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba95ac22-e9fc-462d-8423-d89c8c3fc15d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:35.573448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:35.578457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:35.579126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.579413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.579691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.580506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:35.580820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:35.582216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:35.591144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 621/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:35.595866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:35.672024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:35.694154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe3589-5aa2-4eff-909a-ca58923a53ee None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:35.725932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:35.726707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.726993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.727265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.738067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:35.739508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:35.756929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:35.758037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:35.759122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:35.759122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:35.759122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:35.759122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:35.759122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 630/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:35.763855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:35.863061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b48be-a5cf-4cb0-90f8-bf4f60e349fa None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:35.895795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:35.896452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:35.896756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:35.897015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:35.897729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:35.898073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:35.899431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:35.912227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 622/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:35.918002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.017184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8ba2e-62c4-459c-ad7b-ffe9053a0d07 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:36.043138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:36.051303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:36.052088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:36.052371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:36.052645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:36.060801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:36.062261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:36.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:36.082465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:36.083470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 631/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:36.084096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.141204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:36.183998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad5dc7b-90ad-40bf-9799-16d8a2d12c2e None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:36.217627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:36.218314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:36.218598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:36.218873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:36.219735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:36.220032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:36.221451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:36.238129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 623/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:31:36.244377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.345766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac8437-73e9-4382-ad03-bae1952322b1 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:36.379267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:36.379904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:36.380190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:36.380469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:36.433890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:36.445912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:36.447376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:36.543166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 632/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:31:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:31:36.548940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.648572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127d9cf-ea6a-410d-8d35-0d3e3b5125fb None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:36.661412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:36.681677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:36.682524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:36.682807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:36.683083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:36.693387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:36.694789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:36.713000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:36.713925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:36.715012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:36.715012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:36.715012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:36.715012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:36.715012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 624/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:36.720067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.804990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:36.816942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d37f4-2842-4602-ad33-b2ff6ce40f11 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:36.849642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:36.850331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:36.850615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:36.850889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:36.851589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:36.851894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:36.853240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:36.863997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 633/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:36.870187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:36.967458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7da78-bab5-4533-a37a-afdec3abcca2 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:37.001271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:37.002093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:37.002372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:37.002646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:37.009281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:37.013695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:37.024068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:37.025127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:37.026063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 625/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:37.031107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:37.130052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9ea5a-ec41-4b4c-b648-46e481c309ee None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:37.162319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:37.162964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:37.163245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:37.163569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:37.164492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:37.164803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:37.166245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ac05-ec06-4c7e-889f-bdd83528d030 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:37.178630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 634/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:37.185243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:37.210684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:37.283855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418a2ca-70f0-4c2b-96ee-78a196e98011 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:37.317288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:37.317960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:37.318247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:37.318552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:37.319484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=e33b3d4866d04b0095739952e76255c4) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:37.319798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:37.321211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182531-e887-4c05-b7cb-8177400b8b27 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:37.326718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 626/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:31:37 2022] GET /identity/v3/role_assignments?user.id=e33b3d4866d04b0095739952e76255c4&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:39.306948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fb84-4a41-495a-87e1-c851a6b7dcd7 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:39.307435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fb84-4a41-495a-87e1-c851a6b7dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:39.307622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445fb84-4a41-495a-87e1-c851a6b7dcd7 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:39.308998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 635/1261] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:39.315052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:39.315450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:39.319863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:39.331952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:39.333121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:39.398954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 627/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:39.422955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fb84-4a41-495a-87e1-c851a6b7dcd7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:39.433915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:39.523898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445fb84-4a41-495a-87e1-c851a6b7dcd7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:39.560305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:39.561026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:39.561306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:39.561580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:39.580115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:39.590385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:39.592105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:39.593264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 636/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:31:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:39.598331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:39.617517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:39.697537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7c43a-867b-4fd4-ac20-bfaaf5319ca0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:39.731616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:39.732275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:39.732555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:39.732848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:39.733641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:39.733970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:39.735321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:39.743518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 628/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:31:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:39.749723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:39.821608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:39.854307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab95108-4c90-4e4c-8094-089e19bfc802 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:39.887173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:39.888593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:39.888881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:39.889160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:39.899365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:39.900972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:39.917638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:39.923105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:39.924251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:39.924251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:39.924251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:39.924251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:39.924251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 637/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:39.925226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.011862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:40.030320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddf6fe-d448-4294-ba59-f36c0211850c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.062943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.063600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.063887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.064166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.064889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:40.065195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.066576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.077898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 629/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:40.083699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.184981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad832cc-c247-4cc4-9986-17b0bc815dff None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.204081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:40.218877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.219717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.219997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.220291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.227954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.229371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:40.244340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:40.245269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:40.246893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 638/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:40.251996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.350485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ecbe0c-1505-4a92-86f9-0b01370d24ff None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.383926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.384628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.384910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.385183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.386041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:40.386355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.387903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.396483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:40.405259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 630/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:40.410906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.512909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12de548-bc49-47c8-aaf2-a79bcfeb1509 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.547050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.547831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.548114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.548390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.558821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.560311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:40.577092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:40.578226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:40.579321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:40.579321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:40.579321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:40.579321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:40.579321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 639/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:31:40.584193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.682253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02c0a-7384-4587-9c49-10b90e715598 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.716362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.717021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.717308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.717585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.718333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:40.718644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.720011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.731121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 631/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:40.736794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.768543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:40.837090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0c8c8-c7a6-41ce-b64e-37536592f3ae None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:40.872596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:40.873371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:40.876339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:40.876339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:40.880502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:40.882064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:40.895864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:40.896927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:40.897807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 640/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:40.902907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:40.962543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:41.005199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fd794-fad3-46ba-9111-6accc412cf2f None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:41.038923 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:41.039578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:41.039862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:41.040159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:41.040932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:41.041244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:41.042698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a2a3f-475b-4a66-a6e8-3ab82119f23f None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:41.055182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 632/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:41.062021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:41.152384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:41.161081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7d7da-4d52-479d-abc9-30c7af227b30 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:41.194175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:41.195046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:41.195326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:41.195600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] PATH_INFO: `/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/e33b3d4866d04b0095739952e76255c4/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:41.197643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] RBAC: Authorizing `identity:create_grant(project_id=e9ae89c41e0043cf9cf363c3f81dd53c, user_id=e33b3d4866d04b0095739952e76255c4, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:41.199098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c827f5-83f3-4f22-a3ad-d8929713999c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:41.283330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 641/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Fri Jun 24 03:31:41 2022] PUT /identity/v3/projects/e9ae89c41e0043cf9cf363c3f81dd53c/users/e33b3d4866d04b0095739952e76255c4/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:31:43.290382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31655e9-b23f-4262-a5a6-c327f282bdb2 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:43.290887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31655e9-b23f-4262-a5a6-c327f282bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:43.290887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31655e9-b23f-4262-a5a6-c327f282bdb2 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:43.292235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 633/1274] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:43.298011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943254-34b2-419f-87d7-22760a202592 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:43.298418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943254-34b2-419f-87d7-22760a202592 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:43.298561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943254-34b2-419f-87d7-22760a202592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:43.314816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2e943254-34b2-419f-87d7-22760a202592 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:43.316003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2e943254-34b2-419f-87d7-22760a202592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:43.380304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 642/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:43.403878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31655e9-b23f-4262-a5a6-c327f282bdb2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:43.503585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31655e9-b23f-4262-a5a6-c327f282bdb2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:43.520296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:43.536934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:43.537675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:43.537993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:43.538270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:43.548928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 03:31:43.556768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:43.557881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:43.558781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 634/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Fri Jun 24 03:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:43.564506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943254-34b2-419f-87d7-22760a202592 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:43.645266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:43.662842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943254-34b2-419f-87d7-22760a202592 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:43.696338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:43.697000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:43.697284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:43.697563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:43.698335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:43.698647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:43.700002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:43.707805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 643/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Fri Jun 24 03:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:43.713602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:43.812759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fc3c3-4c73-49ce-9847-9979e0609729 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:43.845224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:43.846039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:43.846323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:43.846596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:43.857549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:43.859123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:43.876638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:43.877720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:43.878908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:43.878908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:43.878908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:43.878908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:43.878908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 635/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:43.883597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:43.989010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053dcea-ee7d-44cb-ad08-1057a769dca0 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:44.022945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:44.023609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:44.023898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:44.024175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:44.024886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:44.025202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:44.026583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:44.038767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 644/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:44.045050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:44.075134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:44.147833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fff7f-3719-48b2-8cb4-8794f47c9f22 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:44.180814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:44.181641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:44.181972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:44.182251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:44.189741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:44.191253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 03:31:44.205338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:44.206450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:44.207400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 636/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:44.212627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:44.217048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:44.315526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ac7e-5784-4f8a-a80d-3cefcd6c2f6c None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:44.352312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:44.352991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:44.353275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:44.353555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:44.354451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:44.354767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:44.356842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:44.377222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 645/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Fri Jun 24 03:31:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:44.383383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:44.481624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:44.492128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd09375-900b-4d17-920e-e79e5e33bec5 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:44.531504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:44.532184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:44.532472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:44.532752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:44.607594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:44.608956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:44.702245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:44.713449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 637/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Fri Jun 24 03:31:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 03:31:44.719916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:44.781982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:44.819204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e946d-38c2-4f88-ba72-807e7e807267 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:44.855721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:44.856514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:44.856799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:44.857077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:44.868010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:44.869384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 03:31:44.887002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:44.888643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:44.889680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 03:31:44.889680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 03:31:44.889680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 03:31:44.889680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:44.889680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 646/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:31:44.894706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:44.995790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f31cb-eb70-4117-af91-d7d255427939 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:45.030947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:45.031601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:45.031882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:45.032153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:45.032861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:45.033163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:45.034596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:45.046078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 638/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Fri Jun 24 03:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:45.051695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:45.150939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fc010-8fe6-40b4-890a-67755e5be3dd None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:45.163782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:45.183219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:45.183987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:45.184879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:45.185150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:45.191553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:45.193001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 03:31:45.207175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:45.208251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: ERROR keystone.server.flask.application Jun 24 03:31:45.209361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 647/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Fri Jun 24 03:31:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:45.214027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:45.263895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:45.312584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87910a-dc1d-43c4-9330-2785ff008c7c None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:45.344761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:45.345408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:45.345692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:45.345998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:45.346770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:45.347075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:45.348469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f618f0c-4fd2-412e-8d54-47d605ad5a27 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:45.360574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 639/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Fri Jun 24 03:31:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:45.366875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:45.462606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74999611-9d20-4f25-b144-9c00e719bb4d None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:45.495936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:45.496571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:45.497412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:45.497692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:45.498592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] RBAC: Adding query filter params (role.id=20658940146144b9b9afa747f31d7a5d, scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c, user.id=e33b3d4866d04b0095739952e76255c4) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:45.498909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:45.500330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0473d-2055-4fbb-a4fc-cb7e95345959 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:45.506268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 648/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Fri Jun 24 03:31:45 2022] GET /identity/v3/role_assignments?user.id=e33b3d4866d04b0095739952e76255c4&scope.project.id=e9ae89c41e0043cf9cf363c3f81dd53c&role.id=20658940146144b9b9afa747f31d7a5d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:47.539454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d271d-07ae-433e-bfbe-bf85a5ff958f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:47.539983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d271d-07ae-433e-bfbe-bf85a5ff958f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:47.539983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d271d-07ae-433e-bfbe-bf85a5ff958f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:47.541400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 640/1288] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:47.546803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:47.547232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:47.547492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:47.563846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:47.565010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:47.595064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:47.633323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 649/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:47.657115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d271d-07ae-433e-bfbe-bf85a5ff958f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:47.758397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d271d-07ae-433e-bfbe-bf85a5ff958f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:47.769305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:47.792258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:47.792982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:47.793267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:47.793541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:47.794211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:47.795565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:47.807369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:47.808597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:47.810183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 641/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:31:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:47.815346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:47.913500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01edbf-c9ce-4b9c-965c-e924a993bc72 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:47.947412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:47.948073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:47.948358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:47.948634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:47.949333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:47.950335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:47.951788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ff35a8-33c8-423d-aefa-9fa6c50abb6b None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:47.956608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 650/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 03:31:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:47.962439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:48.063431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ee4e8-8747-493a-958a-d76f76860e24 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:48.096006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:48.096655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:48.096937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:48.097209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] PATH_INFO: `/v3/services` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:48.097932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:48.098236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:48.099581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cfb569-3d11-47cc-9ee7-52b9b24b2b30 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:48.103960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 642/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 03:31:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:50.122923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f32fe-9024-48b4-b187-ce24ceda5587 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:50.123481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f32fe-9024-48b4-b187-ce24ceda5587 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:50.123481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f32fe-9024-48b4-b187-ce24ceda5587 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:50.124833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 651/1293] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:50.130118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f00b-3ad7-4ce2-98d2-c2bade3c8b63 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:50.130508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f00b-3ad7-4ce2-98d2-c2bade3c8b63 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:50.130690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609f00b-3ad7-4ce2-98d2-c2bade3c8b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:50.148282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d609f00b-3ad7-4ce2-98d2-c2bade3c8b63 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:50.149471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d609f00b-3ad7-4ce2-98d2-c2bade3c8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:50.179488 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:50.216725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 643/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:50.240379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f32fe-9024-48b4-b187-ce24ceda5587 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:50.270999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:50.339642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6f32fe-9024-48b4-b187-ce24ceda5587 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:50.373642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:50.374325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:50.374612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:50.374888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:50.375607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:50.376964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07fff50-e793-4ccd-bbfd-1ba94ce900cd None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:50.432158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 652/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Fri Jun 24 03:31:50 2022] POST /identity/v3/services => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:31:52.464704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9fcb-92f0-4f67-abf5-782532b3e5aa None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:52.465740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9fcb-92f0-4f67-abf5-782532b3e5aa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:52.465740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899c9fcb-92f0-4f67-abf5-782532b3e5aa None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:52.467284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 644/1296] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:52.472398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:52.472822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:52.472996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:52.490169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:52.491605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:52.561955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 653/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:52.585725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9fcb-92f0-4f67-abf5-782532b3e5aa None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:52.686005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899c9fcb-92f0-4f67-abf5-782532b3e5aa None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:52.719595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:52.720335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:52.720614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:52.720896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:52.721548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:52.722948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:52.734896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:52.736099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:52.737312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 645/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:31:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 03:31:52.742410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:52.760370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:52.838823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec242e-a5fb-49f3-ba71-e9a3a61a2a01 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:52.872007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:52.872662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:52.872949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:52.873223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:52.873951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:52.874263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:52.875629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:52.880725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 654/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 03:31:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:52.887392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:52.919843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:52.988888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f387c-503d-4f7f-a045-0472ca9c0cc7 None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:53.022920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:53.023579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:53.023916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:53.024168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:53.024961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] RBAC: Adding query filter params (interface=public, service_id=4cef2ae183ba4752b3723bd57a558079, region_id=RegionOne) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:53.025276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:53.026706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6468545-566c-4327-b637-f872e4470a0d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:53.032428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 646/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Fri Jun 24 03:31:52 2022] GET /identity/v3/endpoints?service_id=4cef2ae183ba4752b3723bd57a558079&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:53.038171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:53.118518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:53.136528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0fb1-5b22-4134-b767-06605d0cf274 None admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:53.169511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:53.170190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:53.170473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:53.170746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:53.171453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:53.172844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1ce15-a593-4de0-8352-ebe175cbf2ce None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:53.179548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 655/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Fri Jun 24 03:31:53 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:31:55.180777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53f96-f7eb-47cb-b038-dadb788cda5a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:55.181292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53f96-f7eb-47cb-b038-dadb788cda5a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:55.181379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe53f96-f7eb-47cb-b038-dadb788cda5a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:55.182768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 647/1302] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:31:55.188379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:55.188803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:55.188930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:55.205295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:31:55.206490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:31:55.271726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 656/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:31:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 03:31:55.295554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe53f96-f7eb-47cb-b038-dadb788cda5a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:55.389748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:55.396523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe53f96-f7eb-47cb-b038-dadb788cda5a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:55.429982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:55.430769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:55.431058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:55.431339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:55.432040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:55.433480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 03:31:55.445244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 03:31:55.446406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application with Lock( Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self._enter() Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application return self.creator() Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application created_value = creator( Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: ERROR keystone.server.flask.application Jun 24 03:31:55.447574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 648/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Fri Jun 24 03:31:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 03:31:55.452645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:55.527238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:31:55.549965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b1eb9-6f74-4e1c-8ed8-418340c379f6 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:55.581559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:55.582239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:55.582521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:55.582798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] PATH_INFO: `/v3/services` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:55.583494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:31:55.583804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:55.585165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc56011-0ca4-486f-934e-4bcbf6559571 None admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:55.590720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 657/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Fri Jun 24 03:31:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:31:55.596547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:31:55.696420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12869832-f5bc-46a3-8f56-ea0e3da99e9d None admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:31:55.730030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:31:55.730713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:31:55.731002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:31:55.731284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:31:55.732094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:31:55.733453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a05a76-44ea-4550-84dd-30b91d6fb6ca None admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:31:55.803296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 649/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Fri Jun 24 03:31:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:32:05.602635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=30 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:32:05.798506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:43.686284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6983-f96e-4d69-be1d-61bd3861a8ae None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:43.687292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6983-f96e-4d69-be1d-61bd3861a8ae None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:43.687820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a6983-f96e-4d69-be1d-61bd3861a8ae None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:43.694756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093831-e761-485c-a749-fcef8061e154 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:43.695582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093831-e761-485c-a749-fcef8061e154 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:43.696093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0093831-e761-485c-a749-fcef8061e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:43.699287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 658/1307] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:43 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:37:43.805627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a0093831-e761-485c-a749-fcef8061e154 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:43.807026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a0093831-e761-485c-a749-fcef8061e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:43.950336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 650/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:44.003979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:44.004490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:44.005329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:44.008989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 659/1309] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 03:37:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:44.018379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e35a1-f776-4f62-85e2-6127242fc480 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:44.019273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e35a1-f776-4f62-85e2-6127242fc480 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:44.020143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e35a1-f776-4f62-85e2-6127242fc480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:44.110992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-425e35a1-f776-4f62-85e2-6127242fc480 None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:44.112368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-425e35a1-f776-4f62-85e2-6127242fc480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:44.134566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:44.193616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 651/1310] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 03:37:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 24 03:37:44.202739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:37:44.205013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:44.315319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa7065a-b9e2-4bad-99a5-d9ffc45ecf46 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:37:44.393419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:37:44.393927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:44.394213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:44.394487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:44.396127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:44.457358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:44.513021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:37:44.514627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ccb10-349e-4246-8cc3-7fc560383230 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:37:44.534233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 660/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:37:46.855374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58669d53-3b12-4809-bd88-79eec11cc286 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:46.855893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58669d53-3b12-4809-bd88-79eec11cc286 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:46.856014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58669d53-3b12-4809-bd88-79eec11cc286 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:46.858348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 652/1312] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:46.862663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84cb8-d85f-4bd5-ace9-1c9c321c6fa7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:46.863060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84cb8-d85f-4bd5-ace9-1c9c321c6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:46.863225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f84cb8-d85f-4bd5-ace9-1c9c321c6fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:46.936371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-86f84cb8-d85f-4bd5-ace9-1c9c321c6fa7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:46.937646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-86f84cb8-d85f-4bd5-ace9-1c9c321c6fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:47.055190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 661/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:47.110388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:47.110570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:47.110853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:47.112449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 653/1314] 10.222.0.42 () {54 vars in 964 bytes} [Fri Jun 24 03:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:47.119037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca880f8-2217-4b81-ab57-0da477e6aca8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:47.119469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca880f8-2217-4b81-ab57-0da477e6aca8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:47.119979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca880f8-2217-4b81-ab57-0da477e6aca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:47.131597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:47.199573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1ca880f8-2217-4b81-ab57-0da477e6aca8 None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:47.200950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1ca880f8-2217-4b81-ab57-0da477e6aca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:47.282324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 662/1315] 10.222.0.42 () {58 vars in 1061 bytes} [Fri Jun 24 03:37:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:47.291433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:37:47.292966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:47.414123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2462ac-17af-4c00-9dc2-57d605f20b97 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:37:47.491640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:47.494485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:37:47.495184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:47.495471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:47.495750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:47.497766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:47.607728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:37:47.609693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5cfe73-76b1-4936-b892-e850443b78d2 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:37:47.628871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 654/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:37:50.340749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:50.341283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:50.341283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:50.342702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 663/1317] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:50.348561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59f03-6d51-4467-bd03-c7c5f58e8ba2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:50.348942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59f03-6d51-4467-bd03-c7c5f58e8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:50.349119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce59f03-6d51-4467-bd03-c7c5f58e8ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:50.413529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6ce59f03-6d51-4467-bd03-c7c5f58e8ba2 None None] MFA Rules not processed for user `1714c86967334b0cba5e44e8951a3b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:50.414789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6ce59f03-6d51-4467-bd03-c7c5f58e8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:50.466345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:50.510757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 655/1318] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:50.551077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:37:50.552627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:50.654782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd376a-900c-414b-bfed-73bd33a25261 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:37:50.658156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:50.727843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:37:50.728482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:50.728762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:50.729034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:50.730711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:50.835618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:37:50.837040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2769ef-8cec-43b4-b54a-ad160488d54e service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:37:50.856564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 664/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:37:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:37:53.664995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:53.665516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:53.665516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:53.666875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 656/1320] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:53.672089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0549a1-d276-452e-8428-fcf5437abf00 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:53.672462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0549a1-d276-452e-8428-fcf5437abf00 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:53.672643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0549a1-d276-452e-8428-fcf5437abf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:53.711117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:53.735536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cd0549a1-d276-452e-8428-fcf5437abf00 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:53.736761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cd0549a1-d276-452e-8428-fcf5437abf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:53.830902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 665/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:53.869448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:37:53.871275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:53.972628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ba94e-14fd-4497-86cf-93f383088c82 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:37:54.044305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:37:54.044949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:54.045228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:54.045500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:54.047194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:54.055381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:54.154368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:37:54.155796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41a97e-c64a-428c-9187-b931c0878856 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:37:54.173185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 657/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:37:57.266663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:57.267166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:57.267166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:57.268509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 666/1323] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:57.273651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be893cf-9db5-43f2-a84e-3c1254600811 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:57.274094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be893cf-9db5-43f2-a84e-3c1254600811 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:57.274262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be893cf-9db5-43f2-a84e-3c1254600811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:57.340729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0be893cf-9db5-43f2-a84e-3c1254600811 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:57.341983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0be893cf-9db5-43f2-a84e-3c1254600811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:57.404353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:57.444724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 658/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:37:57.480657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:37:57.482565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:57.597964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef689acd-3ddf-41bf-b126-6771c4c367b2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:37:57.612067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:57.678854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:37:57.679515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:57.679800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:57.680080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:57.681737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:37:57.792335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:37:57.793768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329ee93-9418-44e2-9262-c48243ec03a6 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:37:57.812367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 667/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:37:59.913899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:59.914455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:59.914455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:59.915845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 659/1326] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:37:59.920949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e141-fdbc-41db-b924-6faf34724be2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:37:59.921354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e141-fdbc-41db-b924-6faf34724be2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:37:59.921545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610e141-fdbc-41db-b924-6faf34724be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:37:59.970732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:37:59.992618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e610e141-fdbc-41db-b924-6faf34724be2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:37:59.992618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e610e141-fdbc-41db-b924-6faf34724be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:00.087934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 668/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:00.123573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:00.125599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:00.228788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2201e329-3102-4443-be2f-7da1996376c6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:00.302275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:00.302849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:00.303136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:00.303411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:00.305048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:00.322746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:00.420886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:00.422883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ef9c0-562c-4242-8f05-04cba6bc2670 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:00.442082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 660/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:02.540908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:02.541457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:02.541457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:02.542893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 669/1329] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:02.548546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f82-c889-4f71-82af-888c66667668 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:02.548974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f82-c889-4f71-82af-888c66667668 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:02.549229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf9f82-c889-4f71-82af-888c66667668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:02.613869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1acf9f82-c889-4f71-82af-888c66667668 None None] MFA Rules not processed for user `1714c86967334b0cba5e44e8951a3b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:02.615098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1acf9f82-c889-4f71-82af-888c66667668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:02.684643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:02.717635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 661/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:02.755809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:02.757371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:02.861247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080db0f6-38c9-45f9-9e7b-f5eea984ef53 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:02.881571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:02.934426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:02.934986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:02.935265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:02.935535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:02.937692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:03.049792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:03.051256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663bd42-3b2b-475c-b863-c400395f242c service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:03.070063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 670/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:05.726316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:05.726815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:05.726815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:05.728202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 662/1332] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:05.733459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c16f-ee73-49e9-9894-2b032d986c4d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:05.734435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c16f-ee73-49e9-9894-2b032d986c4d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:05.734529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310c16f-ee73-49e9-9894-2b032d986c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:05.797462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:05.801188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9310c16f-ee73-49e9-9894-2b032d986c4d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:05.802434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9310c16f-ee73-49e9-9894-2b032d986c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:05.897576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 671/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:05.933233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:05.934872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:06.038816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe1a3d-fbf7-4138-9128-d6d7e0ee3b76 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:06.110986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:06.111628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:06.111906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:06.112180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:06.113799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:06.141101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:06.222104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:06.223542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5c6f-1853-4294-8eb4-616f115a2fac service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:06.241755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 663/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:08.314463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:08.314966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:08.314966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:08.316299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 672/1335] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:08.321332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb4be-b841-4723-8e36-a12af07489cb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:08.321754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb4be-b841-4723-8e36-a12af07489cb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:08.321913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cb4be-b841-4723-8e36-a12af07489cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:08.387023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1d5cb4be-b841-4723-8e36-a12af07489cb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:08.388253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1d5cb4be-b841-4723-8e36-a12af07489cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:08.462645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:08.484956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 664/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:08.524728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:08.526319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:08.626766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee5c03-8404-4c28-b876-249aff82ffce None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:08.653682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:08.698055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:08.698699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:08.698980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:08.699252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:08.700910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:08.809996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:08.811416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5553d-53f1-4e53-9026-8ba1479f2747 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:08.830050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 673/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:11.381063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:11.381596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:11.381596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:11.383053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 665/1338] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:11.388274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca50-6211-49fb-8172-74536b400c2b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:11.388710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca50-6211-49fb-8172-74536b400c2b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:11.388814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0ca50-6211-49fb-8172-74536b400c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:11.454091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c4e0ca50-6211-49fb-8172-74536b400c2b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:11.455314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c4e0ca50-6211-49fb-8172-74536b400c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:11.463589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:11.553490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 674/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:11.589573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:11.591194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:11.693212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414863c-837a-4a2d-b20c-f3edfcd55665 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:11.764891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:11.765537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:11.765824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:11.766147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:11.767770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:11.802442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:11.875430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:11.876919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb880c-9caa-4994-8f6f-0690bf91b074 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:11.895152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 666/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:16.152109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:16.152633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:16.152633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:16.154071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 675/1341] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:16.159464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239157-b5fd-41e5-897f-274c50c8df62 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:16.159912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239157-b5fd-41e5-897f-274c50c8df62 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:16.160190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06239157-b5fd-41e5-897f-274c50c8df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:16.239518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-06239157-b5fd-41e5-897f-274c50c8df62 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:16.240866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-06239157-b5fd-41e5-897f-274c50c8df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:16.335395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:16.351135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 667/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:16.388976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:16.391081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:16.488553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2ffc6-b44f-4bc3-94d9-4bd5bab72f8c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:16.492150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:16.492799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:16.493080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:16.493354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:16.502915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:16.504338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f594cc-d8ae-40a0-9fbe-de107ba7cff8 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:16.513837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 676/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:19.449573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026a05-9ea1-4959-b8bb-e2230ea4e553 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:19.450126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026a05-9ea1-4959-b8bb-e2230ea4e553 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:19.450218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f026a05-9ea1-4959-b8bb-e2230ea4e553 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:19.451606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 668/1344] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:19.457658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238d2a-3549-44e7-b617-4905d2a947aa None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:19.458230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238d2a-3549-44e7-b617-4905d2a947aa None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:19.458230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4238d2a-3549-44e7-b617-4905d2a947aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:19.489946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c4238d2a-3549-44e7-b617-4905d2a947aa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:19.491172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c4238d2a-3549-44e7-b617-4905d2a947aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:19.521346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:19.573621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 677/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:19.611283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026a05-9ea1-4959-b8bb-e2230ea4e553 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:19.622317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f026a05-9ea1-4959-b8bb-e2230ea4e553 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:19.626421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:19.627155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:19.627452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:19.627712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:19.636596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:19.638948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e07518-5857-43e4-89cd-cbccb91e0911 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:19.648347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 669/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:23.784343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1638-0a92-45fa-9e28-f44b61db37ab None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:23.784898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1638-0a92-45fa-9e28-f44b61db37ab None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:23.784898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1638-0a92-45fa-9e28-f44b61db37ab None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:23.786321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 678/1347] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:23.791458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf24cf7-d132-46e1-999b-ecdf897430af None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:23.791861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf24cf7-d132-46e1-999b-ecdf897430af None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:23.792007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf24cf7-d132-46e1-999b-ecdf897430af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:23.809244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2bf24cf7-d132-46e1-999b-ecdf897430af None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:23.810492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2bf24cf7-d132-46e1-999b-ecdf897430af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:23.818395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 670/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:23.856870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1638-0a92-45fa-9e28-f44b61db37ab None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:23.867586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1638-0a92-45fa-9e28-f44b61db37ab None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:23.871228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:23.872126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:23.872409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:23.872689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:23.882577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:23.883999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47975dd-ad4b-426d-a456-eeb312ea6a76 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:23.894021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 679/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:28.873525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c26bb-1fd9-4d72-b750-bcf697bacdcb None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:28.874031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c26bb-1fd9-4d72-b750-bcf697bacdcb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:28.874349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81c26bb-1fd9-4d72-b750-bcf697bacdcb None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:28.876044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 671/1350] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:28.881517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26e9d-13bf-4759-a62f-bb21f33d0bab None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:28.882122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26e9d-13bf-4759-a62f-bb21f33d0bab None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:28.882122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d26e9d-13bf-4759-a62f-bb21f33d0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:29.000365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-00d26e9d-13bf-4759-a62f-bb21f33d0bab None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:29.001609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-00d26e9d-13bf-4759-a62f-bb21f33d0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:29.079426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 680/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:38:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:33.183705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495e2e-dbb7-4b3e-a294-c3791e991d63 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:33.184584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495e2e-dbb7-4b3e-a294-c3791e991d63 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:33.185029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb495e2e-dbb7-4b3e-a294-c3791e991d63 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:33.186985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 672/1352] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:33.192137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f29e2-113d-4f2c-9814-15000edc548c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:33.192552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f29e2-113d-4f2c-9814-15000edc548c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:33.192689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f29e2-113d-4f2c-9814-15000edc548c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:33.212503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-416f29e2-113d-4f2c-9814-15000edc548c None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:33.213702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-416f29e2-113d-4f2c-9814-15000edc548c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:33.222658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 681/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:33.804567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=13 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:34.895592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f316-a3c9-43f4-a0c3-da5ec2429819 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:34.896237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f316-a3c9-43f4-a0c3-da5ec2429819 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:34.896237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6f316-a3c9-43f4-a0c3-da5ec2429819 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:34.897744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 673/1354] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:34.903045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f949c-d763-4eb4-8714-4bb087cf2f6a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:34.903452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f949c-d763-4eb4-8714-4bb087cf2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:34.903627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f949c-d763-4eb4-8714-4bb087cf2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:34.923076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-872f949c-d763-4eb4-8714-4bb087cf2f6a None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:34.924346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-872f949c-d763-4eb4-8714-4bb087cf2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:34.932954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 682/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:38:38.511618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65686c-b60b-471c-8d0c-daa41906af39 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:38.512130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65686c-b60b-471c-8d0c-daa41906af39 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:38.512130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65686c-b60b-471c-8d0c-daa41906af39 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:38.514821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 674/1356] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:38.520513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911606-5f8b-4be6-b69d-e7ebe0b39c7f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:38.520949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911606-5f8b-4be6-b69d-e7ebe0b39c7f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:38.521068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85911606-5f8b-4be6-b69d-e7ebe0b39c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:38.543790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-85911606-5f8b-4be6-b69d-e7ebe0b39c7f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:38.545338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-85911606-5f8b-4be6-b69d-e7ebe0b39c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:38.554399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 683/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:38.612654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666545-50c3-47cf-88bd-d22c1cb8072a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:38.619677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666545-50c3-47cf-88bd-d22c1cb8072a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:38.619677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a666545-50c3-47cf-88bd-d22c1cb8072a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:38.619677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 675/1358] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 03:38:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:38.627045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af288f-6f43-45bd-a4a2-3818744ee7a7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:38.627839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af288f-6f43-45bd-a4a2-3818744ee7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:38.628300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af288f-6f43-45bd-a4a2-3818744ee7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:38.672967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:38.680728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-58af288f-6f43-45bd-a4a2-3818744ee7a7 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:38.682093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-58af288f-6f43-45bd-a4a2-3818744ee7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:38.770594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 684/1359] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:38.778788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a666545-50c3-47cf-88bd-d22c1cb8072a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:38.797236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a666545-50c3-47cf-88bd-d22c1cb8072a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:38.803282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:38.804031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:38.812153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:38.812153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:38.814276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:38.815896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ec5a9-f969-4cc1-976f-060b71679933 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:38.826667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 676/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:41.074373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00398a-274c-4e27-bfe5-5f2d8b5f9fc0 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:41.074904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00398a-274c-4e27-bfe5-5f2d8b5f9fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:41.075015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00398a-274c-4e27-bfe5-5f2d8b5f9fc0 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:41.076314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 685/1361] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:41.082037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68326-759d-4a38-9270-1588f3e3562d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:41.082432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68326-759d-4a38-9270-1588f3e3562d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:41.082604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb68326-759d-4a38-9270-1588f3e3562d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:41.100886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-acb68326-759d-4a38-9270-1588f3e3562d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:41.102135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-acb68326-759d-4a38-9270-1588f3e3562d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:41.110125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 677/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:41.154397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00398a-274c-4e27-bfe5-5f2d8b5f9fc0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:41.168968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d00398a-274c-4e27-bfe5-5f2d8b5f9fc0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:41.174448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:41.175107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:41.175389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:41.175669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:41.184255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:41.185877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8631e97-6a85-40e8-915d-3cd7c0e460b4 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:41.196194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 686/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:43.710374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c89f9-1a33-401f-bbf2-dd369edf0338 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:43.710863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c89f9-1a33-401f-bbf2-dd369edf0338 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:43.710863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c89f9-1a33-401f-bbf2-dd369edf0338 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:43.712195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 678/1364] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:43.717618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24660-bbc5-4f43-b567-c2aee2fd6242 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:43.718093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24660-bbc5-4f43-b567-c2aee2fd6242 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:43.718227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b24660-bbc5-4f43-b567-c2aee2fd6242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:43.736531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-19b24660-bbc5-4f43-b567-c2aee2fd6242 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:43.737727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-19b24660-bbc5-4f43-b567-c2aee2fd6242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:43.745441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 687/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:43.790878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702345fb-bb16-415f-a7c0-590b6dc2031f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:43.791165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702345fb-bb16-415f-a7c0-590b6dc2031f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:43.791450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702345fb-bb16-415f-a7c0-590b6dc2031f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:43.792933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 679/1366] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 03:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:43.798559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f76f6-f7e1-430b-a505-b3067193c3f0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:43.798849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f76f6-f7e1-430b-a505-b3067193c3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:43.799156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806f76f6-f7e1-430b-a505-b3067193c3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:43.817819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-806f76f6-f7e1-430b-a505-b3067193c3f0 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:43.819026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-806f76f6-f7e1-430b-a505-b3067193c3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:43.828340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 688/1367] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:38:43.836943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702345fb-bb16-415f-a7c0-590b6dc2031f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:43.851315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702345fb-bb16-415f-a7c0-590b6dc2031f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:43.864216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:43.864857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:43.865166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:43.865442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:43.875010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:43.876580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58679c-8443-462d-94c8-090ee6d4e13c service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:43.886255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 680/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:46.189521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8108-007d-48e8-a27f-78836e176229 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:46.190118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8108-007d-48e8-a27f-78836e176229 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:46.190118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e8108-007d-48e8-a27f-78836e176229 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:46.191407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 689/1369] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:46.196613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18f1d-05b4-48e4-a04a-07655630e345 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:46.197374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18f1d-05b4-48e4-a04a-07655630e345 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:46.197816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb18f1d-05b4-48e4-a04a-07655630e345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:46.216387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-bbb18f1d-05b4-48e4-a04a-07655630e345 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:46.218403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bbb18f1d-05b4-48e4-a04a-07655630e345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:46.226552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 681/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:46.270034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8108-007d-48e8-a27f-78836e176229 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:46.285712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e8108-007d-48e8-a27f-78836e176229 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:46.291284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:46.292033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:46.292414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:46.292823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:46.302187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:46.303854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64eb88-a8d7-4499-8a65-c2785a0378b3 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:46.314133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 690/1371] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:46.642038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321477fc-d087-4e79-9143-c2b90691ac24 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:46.642524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321477fc-d087-4e79-9143-c2b90691ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:46.643034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321477fc-d087-4e79-9143-c2b90691ac24 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:46.644788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 682/1372] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:46.650182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2777-682e-4254-8551-084793a5cf23 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:46.650685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2777-682e-4254-8551-084793a5cf23 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:46.651084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e2777-682e-4254-8551-084793a5cf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:46.669374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-847e2777-682e-4254-8551-084793a5cf23 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:46.670752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-847e2777-682e-4254-8551-084793a5cf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:46.679093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 691/1373] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:47.024350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621e14-05af-41d9-90ac-fff525b1fa80 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:47.024350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621e14-05af-41d9-90ac-fff525b1fa80 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:47.024350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9621e14-05af-41d9-90ac-fff525b1fa80 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:47.025424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 683/1374] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 03:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:47.031070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b58d53-2537-4467-86a4-b2f242512bb9 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:47.031364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b58d53-2537-4467-86a4-b2f242512bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:47.031643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b58d53-2537-4467-86a4-b2f242512bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:47.081893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c7b58d53-2537-4467-86a4-b2f242512bb9 None None] MFA Rules not processed for user `eb1e0a3ad767472cafc4ce0ede2f6a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:47.083112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c7b58d53-2537-4467-86a4-b2f242512bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:47.147609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 692/1375] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:47.155447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9621e14-05af-41d9-90ac-fff525b1fa80 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:47.166274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9621e14-05af-41d9-90ac-fff525b1fa80 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:47.169814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:47.170512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:47.170801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:47.171078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:47.180352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:47.181783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e3aab6-165c-404d-8bca-93cae13f6ff7 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:47.192305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 684/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:38:48.476341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27d1b-1126-474d-8e57-20dc5aa32aba None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:48.476878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27d1b-1126-474d-8e57-20dc5aa32aba None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:48.476878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb27d1b-1126-474d-8e57-20dc5aa32aba None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:48.478398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 693/1377] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:48.483573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f021e-fd77-4f31-b273-c4a58d47ecf7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:48.483962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f021e-fd77-4f31-b273-c4a58d47ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:48.484150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f021e-fd77-4f31-b273-c4a58d47ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:48.501616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-be0f021e-fd77-4f31-b273-c4a58d47ecf7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:48.502844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-be0f021e-fd77-4f31-b273-c4a58d47ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:48.510753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 685/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:48.554129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27d1b-1126-474d-8e57-20dc5aa32aba None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:48.568330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb27d1b-1126-474d-8e57-20dc5aa32aba None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:48.573808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:48.574473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:48.574758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:48.575033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:48.583804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:48.585379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6359b-c7e4-40c0-9563-f86d54a9313a service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:48.589519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:38:48.596321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 694/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:50.790211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2584d7-5f32-492f-9ba4-e83c631288c3 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:50.790788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2584d7-5f32-492f-9ba4-e83c631288c3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:50.790788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2584d7-5f32-492f-9ba4-e83c631288c3 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:50.792154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 686/1380] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:50.797395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627e31f-41b2-48b7-9a81-9bf05062026d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:50.797819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627e31f-41b2-48b7-9a81-9bf05062026d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:50.798015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627e31f-41b2-48b7-9a81-9bf05062026d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:50.821051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8627e31f-41b2-48b7-9a81-9bf05062026d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:50.822575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8627e31f-41b2-48b7-9a81-9bf05062026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:50.834101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 695/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:50.887835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2584d7-5f32-492f-9ba4-e83c631288c3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:50.904817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2584d7-5f32-492f-9ba4-e83c631288c3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:50.911467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:50.912235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:50.912640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:50.913142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:50.923074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:50.924660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9615f-70bf-4314-8fe9-5762c4ea007a service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:50.953318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 687/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:53.110038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4af-e6a9-47d6-b0a4-a9548d475abd None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:53.110556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4af-e6a9-47d6-b0a4-a9548d475abd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:53.110667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aefa4af-e6a9-47d6-b0a4-a9548d475abd None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:53.111950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 696/1383] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:53.117118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116584-9071-40d6-9091-62882c94c8b5 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:53.117501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116584-9071-40d6-9091-62882c94c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:53.117672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d116584-9071-40d6-9091-62882c94c8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:53.135926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8d116584-9071-40d6-9091-62882c94c8b5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:53.137096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8d116584-9071-40d6-9091-62882c94c8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:53.144832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 688/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:53.188173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa4af-e6a9-47d6-b0a4-a9548d475abd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:53.203127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aefa4af-e6a9-47d6-b0a4-a9548d475abd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:53.209046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:53.209689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:53.210018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:53.210298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:53.224316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:53.225466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d501d-69f1-4af0-850a-2905cda718ec service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:53.238075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 697/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:55.256356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8118-e498-42d7-99e1-7c95dbc770bc None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:55.257009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8118-e498-42d7-99e1-7c95dbc770bc None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:55.257009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d8118-e498-42d7-99e1-7c95dbc770bc None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:55.258305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 689/1386] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:38:55.264348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c725df-ded3-4d05-b1bb-bc3310372342 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:55.264926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c725df-ded3-4d05-b1bb-bc3310372342 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:55.264926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c725df-ded3-4d05-b1bb-bc3310372342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:55.283562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-42c725df-ded3-4d05-b1bb-bc3310372342 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:55.284747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-42c725df-ded3-4d05-b1bb-bc3310372342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:55.292579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 698/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:38:55.337820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d8118-e498-42d7-99e1-7c95dbc770bc None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:55.352204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d8118-e498-42d7-99e1-7c95dbc770bc None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:55.357594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:55.358267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:55.358550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:55.358879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:55.367056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:55.368620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b687bd-a568-43c4-be20-1862c0effedb service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:55.378893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 690/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:57.531471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02d16-8ccc-4bbd-9b6a-38a2da20e01d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:57.532039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02d16-8ccc-4bbd-9b6a-38a2da20e01d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:57.532293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec02d16-8ccc-4bbd-9b6a-38a2da20e01d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:57.534115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 699/1389] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:57.539454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319a78-dcd8-434a-96dc-8bb6cbdb5146 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:57.539868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319a78-dcd8-434a-96dc-8bb6cbdb5146 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:57.540008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51319a78-dcd8-434a-96dc-8bb6cbdb5146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:57.557524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-51319a78-dcd8-434a-96dc-8bb6cbdb5146 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:57.559042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-51319a78-dcd8-434a-96dc-8bb6cbdb5146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:38:57.567301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 691/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:38:57.622735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02d16-8ccc-4bbd-9b6a-38a2da20e01d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:38:57.638157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec02d16-8ccc-4bbd-9b6a-38a2da20e01d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:38:57.643902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:38:57.644788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:57.645083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:57.645371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:57.653994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:38:57.656082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da902756-646f-4c70-9bef-127fae4895f3 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:38:57.665992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 700/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:38:59.961443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449466-c6fe-40e0-ae75-c4ed2103df10 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:59.962043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449466-c6fe-40e0-ae75-c4ed2103df10 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:59.962043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449466-c6fe-40e0-ae75-c4ed2103df10 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:59.963439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 692/1392] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:38:59.969677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176986d4-381e-4798-90af-46934f8477d6 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:38:59.970127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176986d4-381e-4798-90af-46934f8477d6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:38:59.970285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176986d4-381e-4798-90af-46934f8477d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:38:59.994683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-176986d4-381e-4798-90af-46934f8477d6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:38:59.996521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-176986d4-381e-4798-90af-46934f8477d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:00.007504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 701/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:00.051834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449466-c6fe-40e0-ae75-c4ed2103df10 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:00.067388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449466-c6fe-40e0-ae75-c4ed2103df10 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:00.072825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:00.073466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:00.073748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:00.074054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:00.083021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:00.084604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccac50-2c3a-4f58-b19c-49195bc53475 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:00.094162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 693/1394] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:02.312031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d590ae-8060-40d5-9203-008b67d67d8b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.312584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d590ae-8060-40d5-9203-008b67d67d8b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.312584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d590ae-8060-40d5-9203-008b67d67d8b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.313935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 702/1395] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:02.319303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a75e2-89f9-4a3e-8934-e17eaa633592 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.319696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a75e2-89f9-4a3e-8934-e17eaa633592 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.319900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a75e2-89f9-4a3e-8934-e17eaa633592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.338146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a49a75e2-89f9-4a3e-8934-e17eaa633592 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:02.339354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a49a75e2-89f9-4a3e-8934-e17eaa633592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:02.347393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 694/1396] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:02.392731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d590ae-8060-40d5-9203-008b67d67d8b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:02.407429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d590ae-8060-40d5-9203-008b67d67d8b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:02.412968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:02.413671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.414010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.414313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.422924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:02.424492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd10ec2-c028-4816-a734-4888c6298160 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:02.434162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 703/1397] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:02.507869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525271-ee5a-40ea-9216-233e24dd781d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.508162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525271-ee5a-40ea-9216-233e24dd781d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.508448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87525271-ee5a-40ea-9216-233e24dd781d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.509898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 695/1398] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:02.515478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be197-bc13-42a8-8dc3-d3246162fc78 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.515772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be197-bc13-42a8-8dc3-d3246162fc78 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.516079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160be197-bc13-42a8-8dc3-d3246162fc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.534791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-160be197-bc13-42a8-8dc3-d3246162fc78 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:02.536195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-160be197-bc13-42a8-8dc3-d3246162fc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:02.544256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 704/1399] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:02.610141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aacf-9ce3-49a4-b0eb-e34553aad7c9 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.610504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aacf-9ce3-49a4-b0eb-e34553aad7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.610855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62aacf-9ce3-49a4-b0eb-e34553aad7c9 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.612269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 696/1400] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 03:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:02.617380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579f0a-d02b-4050-be4f-106df8b72f47 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.617671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579f0a-d02b-4050-be4f-106df8b72f47 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.617978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1579f0a-d02b-4050-be4f-106df8b72f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.673425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e1579f0a-d02b-4050-be4f-106df8b72f47 None None] MFA Rules not processed for user `52be421a60704a2f83174973f5d9cfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:02.674707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e1579f0a-d02b-4050-be4f-106df8b72f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:02.738351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 705/1401] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 03:39:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:39:02.746072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62aacf-9ce3-49a4-b0eb-e34553aad7c9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:02.758124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62aacf-9ce3-49a4-b0eb-e34553aad7c9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:02.761787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:02.762492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:02.762773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:02.763044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:02.772529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:02.773974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8ec33-b5d4-4744-8ad7-7cfbf5d04baa service glance] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:02.783469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 697/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:03.677632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8fd2-4ed8-4a66-8feb-70084786c589 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:03.678117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8fd2-4ed8-4a66-8feb-70084786c589 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:03.678223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e8fd2-4ed8-4a66-8feb-70084786c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:03.728962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-df4e8fd2-4ed8-4a66-8feb-70084786c589 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:03.730586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-df4e8fd2-4ed8-4a66-8feb-70084786c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:03.772008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:03.796281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 706/1403] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:39:03.841038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43baa9f-daaa-4f3b-8ef1-69f7461c2d53 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:03.841477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43baa9f-daaa-4f3b-8ef1-69f7461c2d53 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:03.841586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43baa9f-daaa-4f3b-8ef1-69f7461c2d53 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:03.843638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 698/1404] 10.222.0.42 () {54 vars in 942 bytes} [Fri Jun 24 03:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:03.850204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e575-af77-499e-a809-ef3feb1fcb29 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:03.850503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e575-af77-499e-a809-ef3feb1fcb29 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:03.850805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474e575-af77-499e-a809-ef3feb1fcb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:03.898231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0474e575-af77-499e-a809-ef3feb1fcb29 None None] MFA Rules not processed for user `596a616025ee4112af72d799216c2fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:03.899429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0474e575-af77-499e-a809-ef3feb1fcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:03.970011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 707/1405] 10.222.0.42 () {58 vars in 1039 bytes} [Fri Jun 24 03:39:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:03.979340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43baa9f-daaa-4f3b-8ef1-69f7461c2d53 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:03.987390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=61 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:03.993654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43baa9f-daaa-4f3b-8ef1-69f7461c2d53 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:03.999510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:04.000157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:04.000760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:04.000760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:04.009147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:04.010755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafdb3c-1d30-4e9c-b31e-8dbb32c7f8d0 service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:04.019020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 699/1406] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:39:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:39:04.651097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d742-57cd-47fb-be74-0a602d3f4157 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:04.651635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d742-57cd-47fb-be74-0a602d3f4157 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:04.652073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573d742-57cd-47fb-be74-0a602d3f4157 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:04.653486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 708/1407] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:04.659397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c5e4-9a30-44f7-a5d3-976be1bd88bb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:04.659686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c5e4-9a30-44f7-a5d3-976be1bd88bb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:04.659969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c5e4-9a30-44f7-a5d3-976be1bd88bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:04.678842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2af6c5e4-9a30-44f7-a5d3-976be1bd88bb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:04.680051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2af6c5e4-9a30-44f7-a5d3-976be1bd88bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:04.689758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 700/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:04.734213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573d742-57cd-47fb-be74-0a602d3f4157 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:04.751443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573d742-57cd-47fb-be74-0a602d3f4157 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:04.757265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:04.757945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:04.758237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:04.758517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:04.771040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:04.772879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc58713-d99f-499c-8381-461fda2bd0de service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:04.783478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 709/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:14.673504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=8 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:14.778873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=59 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:26.922505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba39f-08df-4d27-b81f-006678f6577c None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:26.923075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba39f-08df-4d27-b81f-006678f6577c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:26.923075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaba39f-08df-4d27-b81f-006678f6577c None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:26.924431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 701/1410] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 03:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:26.929384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef3ea-7344-44bf-8820-6ac12ae53e05 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:26.929823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef3ea-7344-44bf-8820-6ac12ae53e05 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:26.929958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fef3ea-7344-44bf-8820-6ac12ae53e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:26.947452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-52fef3ea-7344-44bf-8820-6ac12ae53e05 None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:26.948636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-52fef3ea-7344-44bf-8820-6ac12ae53e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:26.957047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 710/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:26.971282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30398b-cf6e-4bc1-8069-de0a33dd727f None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:26.971569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30398b-cf6e-4bc1-8069-de0a33dd727f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:26.971845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30398b-cf6e-4bc1-8069-de0a33dd727f None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:26.973201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 702/1412] 10.222.0.42 () {54 vars in 918 bytes} [Fri Jun 24 03:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:26.977683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03310b7a-a452-436e-8d79-3e84710481ed None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:26.977996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03310b7a-a452-436e-8d79-3e84710481ed None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:26.978270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03310b7a-a452-436e-8d79-3e84710481ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:26.996254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-03310b7a-a452-436e-8d79-3e84710481ed None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:26.997442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-03310b7a-a452-436e-8d79-3e84710481ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:27.006836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 711/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Fri Jun 24 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:39:29.485249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b189b0-b167-41fc-b92d-3c75223a7bfd None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:29.485740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b189b0-b167-41fc-b92d-3c75223a7bfd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:29.485872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b189b0-b167-41fc-b92d-3c75223a7bfd None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:29.487364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:29.492882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e977c-3130-4288-9f5a-42660ce86a82 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:29.493294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e977c-3130-4288-9f5a-42660ce86a82 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:29.493473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e977c-3130-4288-9f5a-42660ce86a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:29.512258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e78e977c-3130-4288-9f5a-42660ce86a82 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:29.514081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e78e977c-3130-4288-9f5a-42660ce86a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:29.522083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:29.566639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b189b0-b167-41fc-b92d-3c75223a7bfd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:29.580826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b189b0-b167-41fc-b92d-3c75223a7bfd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:29.586703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:29.587354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:29.587638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:29.587912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:29.596398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:29.598019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6814c28-aba8-4815-a12f-38762a3f3b64 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:29.607931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 704/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:30.504492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf560c-5691-4d46-8259-2795473dfa0e None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:30.505156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf560c-5691-4d46-8259-2795473dfa0e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:30.505156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf560c-5691-4d46-8259-2795473dfa0e None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:30.506527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:30.511410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4069c-2150-47b9-9852-d2303970464f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:30.511831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4069c-2150-47b9-9852-d2303970464f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:30.511976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4069c-2150-47b9-9852-d2303970464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:30.530895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c3f4069c-2150-47b9-9852-d2303970464f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:30.532103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c3f4069c-2150-47b9-9852-d2303970464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:30.540069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:30.690660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf560c-5691-4d46-8259-2795473dfa0e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:30.705519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf560c-5691-4d46-8259-2795473dfa0e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:30.711043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:30.711668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:30.711950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:30.712225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:30.720489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:30.722092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a930aa-365e-46d8-af08-5ecc6c375a3d service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:30.731480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 714/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:31.606476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd8462-fcdc-4a71-bd8c-d6b0805e7d3b None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:31.607625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd8462-fcdc-4a71-bd8c-d6b0805e7d3b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:31.607625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd8462-fcdc-4a71-bd8c-d6b0805e7d3b None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:31.609006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:31.613816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d0a2-8a27-4ba9-a4e2-0afc15c767a8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:31.614227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d0a2-8a27-4ba9-a4e2-0afc15c767a8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:31.614399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824d0a2-8a27-4ba9-a4e2-0afc15c767a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:31.632217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7824d0a2-8a27-4ba9-a4e2-0afc15c767a8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:31.633411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7824d0a2-8a27-4ba9-a4e2-0afc15c767a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:31.641170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:31.789545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd8462-fcdc-4a71-bd8c-d6b0805e7d3b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:31.804171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd8462-fcdc-4a71-bd8c-d6b0805e7d3b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:31.809509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:31.810748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:31.811028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:31.811301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:31.819453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:31.821068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06547d-4b6c-4643-a283-dbd132a3a852 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:31.830437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 707/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:32.681777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce5f-0970-4747-a892-67458ebbab5c None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:32.682377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce5f-0970-4747-a892-67458ebbab5c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:32.682377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4658ce5f-0970-4747-a892-67458ebbab5c None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:32.683762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:32.688699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271806-700c-42eb-9c74-8d0d05cff88c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:32.689127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271806-700c-42eb-9c74-8d0d05cff88c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:32.689249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271806-700c-42eb-9c74-8d0d05cff88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:32.707668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3a271806-700c-42eb-9c74-8d0d05cff88c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:32.708863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3a271806-700c-42eb-9c74-8d0d05cff88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:32.717377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:32.866831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658ce5f-0970-4747-a892-67458ebbab5c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:32.881733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4658ce5f-0970-4747-a892-67458ebbab5c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:32.887039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:32.887662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:32.887944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:32.888807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:32.896698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:32.898337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b040f-eecd-43df-8972-4192ec8591f7 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:32.907482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 717/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:33.759405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1252d-f8a7-4579-886c-b72d3b55df28 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:33.759966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1252d-f8a7-4579-886c-b72d3b55df28 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:33.759966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1252d-f8a7-4579-886c-b72d3b55df28 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:33.761251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:33.766417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702778-bc22-49a8-b1f9-b84037fde947 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:33.766858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702778-bc22-49a8-b1f9-b84037fde947 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:33.766966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89702778-bc22-49a8-b1f9-b84037fde947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:33.785141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-89702778-bc22-49a8-b1f9-b84037fde947 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:33.786367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-89702778-bc22-49a8-b1f9-b84037fde947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:33.794050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:33.942382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1252d-f8a7-4579-886c-b72d3b55df28 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:33.957282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1252d-f8a7-4579-886c-b72d3b55df28 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:33.962769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:33.963397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:33.963680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:33.963993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:33.972672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:33.974313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652958a-dd4a-40dc-bbc3-1eb3194954a5 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:33.983863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 710/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:34.836265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07c70-88e4-43b4-9a3c-121467b0ef91 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:34.836795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07c70-88e4-43b4-9a3c-121467b0ef91 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:34.836892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc07c70-88e4-43b4-9a3c-121467b0ef91 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:34.838240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:34.843441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620948f5-7a6b-498c-9637-96c933137b00 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:34.843869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620948f5-7a6b-498c-9637-96c933137b00 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:34.844027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620948f5-7a6b-498c-9637-96c933137b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:34.862898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-620948f5-7a6b-498c-9637-96c933137b00 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:34.864091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-620948f5-7a6b-498c-9637-96c933137b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:34.871906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:35.021630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07c70-88e4-43b4-9a3c-121467b0ef91 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:35.035780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc07c70-88e4-43b4-9a3c-121467b0ef91 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:35.041040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:35.041687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:35.042009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:35.042283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:35.050662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:35.052217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c79c702-1fb7-4d19-93f5-cd0e0e589bf2 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:35.061973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 720/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:35.915568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3bf2-a722-4858-a147-df8f2676f1e2 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:35.916100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3bf2-a722-4858-a147-df8f2676f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:35.916100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba3bf2-a722-4858-a147-df8f2676f1e2 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:35.917483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:35.923139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719142d-78e0-4156-9c62-242f370ce8ea None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:35.923568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719142d-78e0-4156-9c62-242f370ce8ea None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:35.923690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719142d-78e0-4156-9c62-242f370ce8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:35.941161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7719142d-78e0-4156-9c62-242f370ce8ea None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:35.942366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7719142d-78e0-4156-9c62-242f370ce8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:35.950112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:36.100026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba3bf2-a722-4858-a147-df8f2676f1e2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:36.114821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba3bf2-a722-4858-a147-df8f2676f1e2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:36.120206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:36.120838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:36.121125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:36.121404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:36.129797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:36.131391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175c4ed-8124-4307-90fb-303cc9031f0f service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:36.140732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 713/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:36.990924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c88-ee5c-4367-a2d9-e2bc44ed2adc None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:36.991478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c88-ee5c-4367-a2d9-e2bc44ed2adc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:36.991478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76329c88-ee5c-4367-a2d9-e2bc44ed2adc None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:36.992861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:36.998202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79234-c7ae-4f93-bb9b-4d0af0f30297 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:36.998897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79234-c7ae-4f93-bb9b-4d0af0f30297 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:36.999000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be79234-c7ae-4f93-bb9b-4d0af0f30297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:37.017566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7be79234-c7ae-4f93-bb9b-4d0af0f30297 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:37.018801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7be79234-c7ae-4f93-bb9b-4d0af0f30297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:37.026741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:37.177220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329c88-ee5c-4367-a2d9-e2bc44ed2adc None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:37.192326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76329c88-ee5c-4367-a2d9-e2bc44ed2adc None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:37.197689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:37.198361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:37.198648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:37.198920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:37.206958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:37.208522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2ef87-30b7-401f-ae99-d653f89ca4ad service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:37.217770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 723/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:38.112965 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b428da-ae78-450d-b297-0b610c5800c0 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:38.113503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b428da-ae78-450d-b297-0b610c5800c0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:38.113503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b428da-ae78-450d-b297-0b610c5800c0 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:38.114935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:38.119901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88306b-70a3-466f-80b6-c08ffd57db13 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:38.120326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88306b-70a3-466f-80b6-c08ffd57db13 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:38.120455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88306b-70a3-466f-80b6-c08ffd57db13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:38.139360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0a88306b-70a3-466f-80b6-c08ffd57db13 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:38.140554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0a88306b-70a3-466f-80b6-c08ffd57db13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:38.148290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:38.295841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b428da-ae78-450d-b297-0b610c5800c0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:38.310302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b428da-ae78-450d-b297-0b610c5800c0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:38.315593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:38.316216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:38.316496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:38.316768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:38.324867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:38.327072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36376a-b6c1-475c-8ff4-d9a2bdd69981 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:38.336557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 716/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:40.255040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df319b-a38b-4cf3-929f-37314721cfd8 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:40.255564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df319b-a38b-4cf3-929f-37314721cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:40.255564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df319b-a38b-4cf3-929f-37314721cfd8 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:40.256958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:40.262213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a64e-6c9d-4fb4-aeb0-af0b54e20c73 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:40.262605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a64e-6c9d-4fb4-aeb0-af0b54e20c73 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:40.262774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8a64e-6c9d-4fb4-aeb0-af0b54e20c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:40.280202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f9a8a64e-6c9d-4fb4-aeb0-af0b54e20c73 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:40.281405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f9a8a64e-6c9d-4fb4-aeb0-af0b54e20c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:40.289237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:40.327972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df319b-a38b-4cf3-929f-37314721cfd8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:40.338539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df319b-a38b-4cf3-929f-37314721cfd8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:40.342562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51783023-3628-419f-940f-0cea5223034c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:40.343194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783023-3628-419f-940f-0cea5223034c service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:40.343480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783023-3628-419f-940f-0cea5223034c service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:40.343758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51783023-3628-419f-940f-0cea5223034c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:40.352515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51783023-3628-419f-940f-0cea5223034c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:40.353979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51783023-3628-419f-940f-0cea5223034c service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:40.363865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 726/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:42.563934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827dbb-1645-4f3e-ad7e-f2f62fd82f1a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:42.564479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827dbb-1645-4f3e-ad7e-f2f62fd82f1a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:42.564479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34827dbb-1645-4f3e-ad7e-f2f62fd82f1a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:42.565908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:42.571116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0b670-4958-4115-9c75-de57f4eaba30 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:42.571554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0b670-4958-4115-9c75-de57f4eaba30 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:42.571664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0b670-4958-4115-9c75-de57f4eaba30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:42.589593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-43a0b670-4958-4115-9c75-de57f4eaba30 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:42.590819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-43a0b670-4958-4115-9c75-de57f4eaba30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:42.599104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:42.638572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827dbb-1645-4f3e-ad7e-f2f62fd82f1a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:42.649103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34827dbb-1645-4f3e-ad7e-f2f62fd82f1a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:42.652642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:42.653275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:42.653588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:42.653873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:42.662687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:42.664110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8a2d1-3e60-475b-a0d6-db3223379e54 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:42.673520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 719/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:45.058616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ada442-2ce4-496d-8fe6-410473f5fb09 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:45.059162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ada442-2ce4-496d-8fe6-410473f5fb09 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:45.059162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ada442-2ce4-496d-8fe6-410473f5fb09 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:45.060568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:45.065791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6eba6-766b-4ec7-8fa9-ffc342374aa0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:45.066268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6eba6-766b-4ec7-8fa9-ffc342374aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:45.066379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6eba6-766b-4ec7-8fa9-ffc342374aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:45.084148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-02f6eba6-766b-4ec7-8fa9-ffc342374aa0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:45.085331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-02f6eba6-766b-4ec7-8fa9-ffc342374aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:45.093975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:45.132513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ada442-2ce4-496d-8fe6-410473f5fb09 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:45.143262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ada442-2ce4-496d-8fe6-410473f5fb09 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:45.146886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:45.147520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:45.147808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:45.148089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:45.157598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:45.159062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bd34c1-a6a5-4cbc-bb55-18d3facc5c7a service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:45.168432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 729/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:47.305605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:47.306190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:47.306190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:47.307523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:47.313404 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ea37-2772-419c-8ab1-00eb86847b2c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:47.313801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ea37-2772-419c-8ab1-00eb86847b2c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:47.314028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171ea37-2772-419c-8ab1-00eb86847b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:47.332026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2171ea37-2772-419c-8ab1-00eb86847b2c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:47.333234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2171ea37-2772-419c-8ab1-00eb86847b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:47.341069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:47.380980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:47.382718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:47.396360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57555d-585b-409e-adc1-246e6b5205d3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:47.400028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:47.403854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:47.403854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:47.403854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:47.410414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:47.411949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5189b-d1e8-4e3c-b9be-477e31e814df service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:47.421933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 722/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:49.652739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6672-1710-4c87-9a4a-c52617c8e837 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:49.653797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6672-1710-4c87-9a4a-c52617c8e837 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:49.653797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd6672-1710-4c87-9a4a-c52617c8e837 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:49.655288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:49.660603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb59f-474f-4514-97f6-b5b428541035 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:49.661044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb59f-474f-4514-97f6-b5b428541035 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:49.661171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cb59f-474f-4514-97f6-b5b428541035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:49.679083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1e2cb59f-474f-4514-97f6-b5b428541035 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:49.680280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1e2cb59f-474f-4514-97f6-b5b428541035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:49.688105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:49.725785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6672-1710-4c87-9a4a-c52617c8e837 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:49.736287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd6672-1710-4c87-9a4a-c52617c8e837 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:49.739730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:49.740351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:49.740632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:49.740903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:49.749796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:49.751233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946db4d-739c-4f10-8148-aec25c1363d8 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:49.760415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 732/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:51.887243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3561a9-d829-4070-a549-419e9d384b96 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:51.887837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3561a9-d829-4070-a549-419e9d384b96 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:51.887937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3561a9-d829-4070-a549-419e9d384b96 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:51.890225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:51.895711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad423-6dda-4e9a-a5a8-86f688f95aa7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:51.896140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad423-6dda-4e9a-a5a8-86f688f95aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:51.896269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ad423-6dda-4e9a-a5a8-86f688f95aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:51.913527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ea9ad423-6dda-4e9a-a5a8-86f688f95aa7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:51.914779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ea9ad423-6dda-4e9a-a5a8-86f688f95aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:51.922533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:51.960766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3561a9-d829-4070-a549-419e9d384b96 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:51.971366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3561a9-d829-4070-a549-419e9d384b96 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:51.974919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:51.975558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:51.975839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:51.976112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:51.985701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:51.987162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083c066-0d1d-4ef1-8243-7ceed69600ea service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:51.996824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 725/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:54.079693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b568-2320-4ffe-ad9a-2e29c1baee5d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:54.080225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b568-2320-4ffe-ad9a-2e29c1baee5d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:54.080341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085b568-2320-4ffe-ad9a-2e29c1baee5d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:54.081634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:54.086736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c827-f530-49d7-8115-f8a5810cbc1e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:54.087178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c827-f530-49d7-8115-f8a5810cbc1e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:54.087276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5c827-f530-49d7-8115-f8a5810cbc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:54.105234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-27b5c827-f530-49d7-8115-f8a5810cbc1e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:54.107084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-27b5c827-f530-49d7-8115-f8a5810cbc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:54.114710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:54.152898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085b568-2320-4ffe-ad9a-2e29c1baee5d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:54.164221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085b568-2320-4ffe-ad9a-2e29c1baee5d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:54.167729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:54.168361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:54.168647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:54.169530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:54.178428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:54.179840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aee786-e821-4e45-b3ea-eca2ef036c0f service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:54.189224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 735/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:56.247820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db756d-3d28-42b6-ab50-d479c4894ea6 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:56.248393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db756d-3d28-42b6-ab50-d479c4894ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:56.248393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29db756d-3d28-42b6-ab50-d479c4894ea6 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:56.250023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:56.255263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3f29-ec02-47f3-978d-0e0eb089b863 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:56.255708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3f29-ec02-47f3-978d-0e0eb089b863 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:56.255818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3f29-ec02-47f3-978d-0e0eb089b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:56.261785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=79 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:56.273562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e51a3f29-ec02-47f3-978d-0e0eb089b863 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:56.274833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e51a3f29-ec02-47f3-978d-0e0eb089b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:56.283530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:39:56.321164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db756d-3d28-42b6-ab50-d479c4894ea6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:56.326537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=73 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:39:56.332172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29db756d-3d28-42b6-ab50-d479c4894ea6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:56.335656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:56.336280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:56.336562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:56.336835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:56.346190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:56.347602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0141a0-0cb5-437f-86ce-c5e96009b647 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:56.357916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 728/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:39:58.416733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899141b-f789-4ef0-8995-fdb654f708b2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:58.417264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899141b-f789-4ef0-8995-fdb654f708b2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:58.417396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899141b-f789-4ef0-8995-fdb654f708b2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:58.419380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:39:58.425819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a42f-4cba-4827-9050-c1e88a17c341 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:58.430019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a42f-4cba-4827-9050-c1e88a17c341 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:58.430019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98a42f-4cba-4827-9050-c1e88a17c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:58.443926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ad98a42f-4cba-4827-9050-c1e88a17c341 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:39:58.445129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ad98a42f-4cba-4827-9050-c1e88a17c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:39:58.453024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:39:58.489881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899141b-f789-4ef0-8995-fdb654f708b2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:39:58.500899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899141b-f789-4ef0-8995-fdb654f708b2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:39:58.504407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:39:58.505031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:39:58.505311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:39:58.505582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:39:58.514285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:39:58.515689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27ee46-b426-42e7-b8a7-dfebb90399db service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:39:58.524911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 738/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:00.686556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc7711-9fd8-415f-9135-623a1334e6c9 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:00.687060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc7711-9fd8-415f-9135-623a1334e6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:00.687060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc7711-9fd8-415f-9135-623a1334e6c9 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:00.688440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:00.693683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d47da-af13-477b-85cc-07e5985ed712 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:00.694121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d47da-af13-477b-85cc-07e5985ed712 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:00.694291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d47da-af13-477b-85cc-07e5985ed712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:00.712215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-115d47da-af13-477b-85cc-07e5985ed712 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:00.713400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-115d47da-af13-477b-85cc-07e5985ed712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:00.721532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:00.758046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc7711-9fd8-415f-9135-623a1334e6c9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:00.769301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc7711-9fd8-415f-9135-623a1334e6c9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:00.772962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:00.773593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:00.773897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:00.774171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:00.783154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:00.784583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc014e59-cea5-4085-94ca-09e38b2ee338 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:00.794036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 731/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:10.707399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=11 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:40:10.789755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=14 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:40:21.399946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d789810-7436-4f95-bf9e-15be53f5ebae None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:21.400526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d789810-7436-4f95-bf9e-15be53f5ebae None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:21.400641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d789810-7436-4f95-bf9e-15be53f5ebae None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:21.402242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 740/1471] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:21.409062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493764ff-b0ee-4c3e-9472-ce3acdd48794 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:21.409470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493764ff-b0ee-4c3e-9472-ce3acdd48794 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:21.409623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493764ff-b0ee-4c3e-9472-ce3acdd48794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:21.427241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-493764ff-b0ee-4c3e-9472-ce3acdd48794 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:21.428439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-493764ff-b0ee-4c3e-9472-ce3acdd48794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:21.436341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 732/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:21.484158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a50b6-6925-4631-a5bc-cdc49730c2eb None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:21.484448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a50b6-6925-4631-a5bc-cdc49730c2eb None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:21.484728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a50b6-6925-4631-a5bc-cdc49730c2eb None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:21.486165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 741/1473] 10.222.0.42 () {54 vars in 962 bytes} [Fri Jun 24 03:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:21.491092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7327e-609c-4118-a957-ecc9c6a59ed4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:21.491388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7327e-609c-4118-a957-ecc9c6a59ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:21.491663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7327e-609c-4118-a957-ecc9c6a59ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:21.509823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9ec7327e-609c-4118-a957-ecc9c6a59ed4 None None] MFA Rules not processed for user `52be421a60704a2f83174973f5d9cfcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:21.511046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9ec7327e-609c-4118-a957-ecc9c6a59ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:21.518200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 733/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Fri Jun 24 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:21.525648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a50b6-6925-4631-a5bc-cdc49730c2eb None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:21.536842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a50b6-6925-4631-a5bc-cdc49730c2eb None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:21.540428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:21.541053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:21.541338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:21.541615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:21.550836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:21.552254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba25af-7c27-413b-805f-f324817468b9 service glance] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:21.561610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 742/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:23.668512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7787fd1-dbb8-4832-98f9-d39df3812d61 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:23.669065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7787fd1-dbb8-4832-98f9-d39df3812d61 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:23.669065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7787fd1-dbb8-4832-98f9-d39df3812d61 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:23.670476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 734/1476] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:23.675831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9f52-65cc-4814-a3e0-6fa86a90fc81 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:23.676236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9f52-65cc-4814-a3e0-6fa86a90fc81 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:23.676396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a9f52-65cc-4814-a3e0-6fa86a90fc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:23.693958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-595a9f52-65cc-4814-a3e0-6fa86a90fc81 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:23.695165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-595a9f52-65cc-4814-a3e0-6fa86a90fc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:23.703547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 743/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:23.726957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7787fd1-dbb8-4832-98f9-d39df3812d61 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:23.739361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7787fd1-dbb8-4832-98f9-d39df3812d61 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:23.743720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:23.744354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:23.744633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:23.744903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:23.745630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:23.747486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:40:23.747486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:40:23.747486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:40:23.748606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0ced1e-e79e-40d7-8364-f3e63f2ff2f4 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:23.767980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 735/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Fri Jun 24 03:40:23 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:40:25.815873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14643-e92c-4287-8e19-a6340f526293 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:25.816408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14643-e92c-4287-8e19-a6340f526293 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:25.816524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f14643-e92c-4287-8e19-a6340f526293 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:25.817826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 744/1479] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:25.823060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e685e-3b26-4073-8d05-b31284d3c4b2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:25.823465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e685e-3b26-4073-8d05-b31284d3c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:25.823619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e685e-3b26-4073-8d05-b31284d3c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:25.841113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f39e685e-3b26-4073-8d05-b31284d3c4b2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:25.842342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f39e685e-3b26-4073-8d05-b31284d3c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:25.850150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 736/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:25.893371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f14643-e92c-4287-8e19-a6340f526293 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:25.907667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f14643-e92c-4287-8e19-a6340f526293 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:25.912975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:25.913585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:25.913885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:25.914165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:25.923377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:25.925045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b9a8e-9a20-4549-bb8d-5c723ac851ad service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:25.935901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 745/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:28.147379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8683c-763b-467d-8dde-e9f729d42087 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:28.147902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8683c-763b-467d-8dde-e9f729d42087 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:28.148027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8683c-763b-467d-8dde-e9f729d42087 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:28.149328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 737/1482] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:28.154579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd956-4d10-4667-a43a-f8dca8113ab5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:28.155008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd956-4d10-4667-a43a-f8dca8113ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:28.155133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd956-4d10-4667-a43a-f8dca8113ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:28.173123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2e2fd956-4d10-4667-a43a-f8dca8113ab5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:28.174375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2e2fd956-4d10-4667-a43a-f8dca8113ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:28.182260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 746/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:28.218020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8683c-763b-467d-8dde-e9f729d42087 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:28.228742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8683c-763b-467d-8dde-e9f729d42087 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:28.233237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:28.233899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:28.234189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:28.234469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:28.243803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:28.245945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531d579-bcd5-4e61-aa99-2569cc95ee0a service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:28.255739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 738/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:30.314968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984cba-1e5a-40b5-9341-99054477439d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:30.315475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984cba-1e5a-40b5-9341-99054477439d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:30.315475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22984cba-1e5a-40b5-9341-99054477439d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:30.316897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 747/1485] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:30.322256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17a0e-c915-47e8-9a30-d4ac1479bb22 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:30.322667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17a0e-c915-47e8-9a30-d4ac1479bb22 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:30.322814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17a0e-c915-47e8-9a30-d4ac1479bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:30.341735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1fe17a0e-c915-47e8-9a30-d4ac1479bb22 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:30.342947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1fe17a0e-c915-47e8-9a30-d4ac1479bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:30.350740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 739/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:30.388862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22984cba-1e5a-40b5-9341-99054477439d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:30.399834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22984cba-1e5a-40b5-9341-99054477439d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:30.404043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:30.410421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:30.410421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:30.410421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:30.414482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:30.415892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495b06-ac48-4aca-ac4a-f17582a4ae28 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:30.425515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 748/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:32.552569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd9a9-5cb1-4e43-a55a-ad45a78234bc None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:32.553135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd9a9-5cb1-4e43-a55a-ad45a78234bc None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:32.553135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd9a9-5cb1-4e43-a55a-ad45a78234bc None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:32.554590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 740/1488] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:32.560416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0978fd-300d-4be8-a6f8-51dc2c9e38fa None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:32.560823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0978fd-300d-4be8-a6f8-51dc2c9e38fa None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:32.560976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0978fd-300d-4be8-a6f8-51dc2c9e38fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:32.579034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6d0978fd-300d-4be8-a6f8-51dc2c9e38fa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:32.580248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6d0978fd-300d-4be8-a6f8-51dc2c9e38fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:32.588093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 749/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:32.629244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd9a9-5cb1-4e43-a55a-ad45a78234bc None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:32.639999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd9a9-5cb1-4e43-a55a-ad45a78234bc None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:32.643558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:32.644189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:32.644474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:32.644750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:32.653529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:32.654981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a844247-2e90-4cee-bf7f-7e6cc1b1a15f service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:32.664746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 741/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:35.105397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187138b-2462-4b05-8b3e-95a81e664f3a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:35.105939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187138b-2462-4b05-8b3e-95a81e664f3a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:35.106039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187138b-2462-4b05-8b3e-95a81e664f3a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:35.107364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 750/1491] 10.222.0.42 () {54 vars in 926 bytes} [Fri Jun 24 03:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:40:35.112655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65fa13-ebd9-4579-a99a-a32f4ff5c29e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:35.113088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65fa13-ebd9-4579-a99a-a32f4ff5c29e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:35.113220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65fa13-ebd9-4579-a99a-a32f4ff5c29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:35.132402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3e65fa13-ebd9-4579-a99a-a32f4ff5c29e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:40:35.133616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3e65fa13-ebd9-4579-a99a-a32f4ff5c29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:40:35.142155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 742/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Fri Jun 24 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:40:35.180360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187138b-2462-4b05-8b3e-95a81e664f3a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:40:35.191565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187138b-2462-4b05-8b3e-95a81e664f3a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:40:35.195091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:40:35.195722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:40:35.196005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:40:35.196281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:40:35.205864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:40:35.207293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1eeff6-0605-4ee0-ae3a-0ab4835b32eb service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:40:35.216651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 751/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:40:45.126320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=33 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:40:45.212471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=33 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:42:09.206620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.207198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.207198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.224761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:42:09.225972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:09.234160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 743/1494] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:42:09.242985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.243486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.243621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.261918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:42:09.263102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:09.270837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 752/1495] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:42:09.275188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.284640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e11bdb-f36a-4987-8d84-7347f45288ca None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.289122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.289772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.290086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.290356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.291077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:42:09.291379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.292383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.292383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:42:09.292383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:42:09.293269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.305208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 744/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:42:09.314042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.323240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f48106-b22b-4901-9abd-d254f00b984d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.327745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.328384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.328664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.328934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.329622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.331425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.331425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:42:09.331425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:42:09.332613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.465195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 753/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:42:09.469679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.479579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021ebbe-18b1-4dc6-a719-306b48412ed7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.535343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.536011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.536302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.536582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.537270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.538442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.538442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:42:09.538442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:42:09.539503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.640450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 745/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:42:09.644497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.654797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba2b65-15c6-42f2-928f-0dc0304a5c0f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.659824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.660471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.660752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.661023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.661742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.662795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.662795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:42:09.662795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:42:09.663666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.676822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 754/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:42:09.680797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.690572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71affcc-7baa-43f0-8a9f-32b7c5e26cea admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.695227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.695879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.696162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.696437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.697169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.698229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.698229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:42:09.698229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:42:09.699128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47548656-6eb5-4236-91be-49b7b5337007 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.712403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 746/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:42:09.716339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:09.726757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc23cb3-ad96-48b9-a61b-b05df097b8ff admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:09.731287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78336c23-001c-4719-81ff-753760348005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:09.732149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c23-001c-4719-81ff-753760348005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.732431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c23-001c-4719-81ff-753760348005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.732704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78336c23-001c-4719-81ff-753760348005 admin admin] PATH_INFO: `/v3/projects/5c1989f49646494687b8f84ad3368ce6/users/f1dd78ab5abf40beb1766cbb8cdb7d4e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.747734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336c23-001c-4719-81ff-753760348005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1989f49646494687b8f84ad3368ce6, user_id=f1dd78ab5abf40beb1766cbb8cdb7d4e, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:09.748752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-78336c23-001c-4719-81ff-753760348005 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:09.748752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:42:09.748752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:42:09.750706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78336c23-001c-4719-81ff-753760348005 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:09.826345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 755/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:42:09 2022] PUT /identity/v3/projects/5c1989f49646494687b8f84ad3368ce6/users/f1dd78ab5abf40beb1766cbb8cdb7d4e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:42:09.838070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4b83-fb27-4b47-9910-8beb92e0e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.838363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4b83-fb27-4b47-9910-8beb92e0e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.838643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd4b83-fb27-4b47-9910-8beb92e0e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.864581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5dbd4b83-fb27-4b47-9910-8beb92e0e3c3 None None] MFA Rules not processed for user `f1dd78ab5abf40beb1766cbb8cdb7d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:42:09.865771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5dbd4b83-fb27-4b47-9910-8beb92e0e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:09.928019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 747/1502] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:42:09.940852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ccc4-e0d5-4707-b6f8-644b46383460 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.941141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ccc4-e0d5-4707-b6f8-644b46383460 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.941419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232ccc4-e0d5-4707-b6f8-644b46383460 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.942860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 756/1503] 10.222.0.42 () {54 vars in 963 bytes} [Fri Jun 24 03:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:42:09.947616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584e76e-9ad3-4bb2-b3b4-72466700d0f2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:09.947908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584e76e-9ad3-4bb2-b3b4-72466700d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:09.948188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584e76e-9ad3-4bb2-b3b4-72466700d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:09.966267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3584e76e-9ad3-4bb2-b3b4-72466700d0f2 None None] MFA Rules not processed for user `eb1e0a3ad767472cafc4ce0ede2f6a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:42:09.967607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3584e76e-9ad3-4bb2-b3b4-72466700d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:10.010563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:42:10.019248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 748/1504] 10.222.0.42 () {58 vars in 1060 bytes} [Fri Jun 24 03:42:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:42:10.026937 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232ccc4-e0d5-4707-b6f8-644b46383460 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:10.038338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232ccc4-e0d5-4707-b6f8-644b46383460 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:10.041812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:10.042473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:10.042756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:10.043031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:10.051454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:10.052874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:10.061782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 757/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:42:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:42:10.103931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6bf5-57cc-4702-bcf8-712f86746b8a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:10.104241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6bf5-57cc-4702-bcf8-712f86746b8a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:10.104524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f6bf5-57cc-4702-bcf8-712f86746b8a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:10.105830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 749/1506] 10.222.0.42 () {52 vars in 829 bytes} [Fri Jun 24 03:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:42:10.109429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:10.170593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfdf508-55bc-4313-8494-5e775e39c22d service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:10.175089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:10.175944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:10.176223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:10.176495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] PATH_INFO: `/v3/users/f1dd78ab5abf40beb1766cbb8cdb7d4e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:10.177664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1dd78ab5abf40beb1766cbb8cdb7d4e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:10.178702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:10.178702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:42:10.178702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:42:10.179890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:10.493013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1dd78ab5abf40beb1766cbb8cdb7d4e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:10.512007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1dd78ab5abf40beb1766cbb8cdb7d4e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:10.525017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1dd78ab5abf40beb1766cbb8cdb7d4e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:10.525718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1dd78ab5abf40beb1766cbb8cdb7d4e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:10.528769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1dd78ab5abf40beb1766cbb8cdb7d4e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:10.530666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:42:10.727081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 758/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:42:10 2022] DELETE /identity/v3/users/f1dd78ab5abf40beb1766cbb8cdb7d4e => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:42:10.731434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:10.731952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:10.732053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:10.750179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:42:10.751359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:10.809634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 750/1508] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:42:10.821457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:10.823010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:10.879508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdab3b-14ef-409f-b4b2-2ba7876fe0c5 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:10.883035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:10.883675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:10.883954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:10.884240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:10.892919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:10.894380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b58d15-9375-48f4-9502-fe11f2f7e230 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:10.903606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 759/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:42:11.439508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:42:11.440974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:42:11.453152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d86e4-0132-4086-9840-5cc871a9b7df None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:42:11.458146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:42:11.458961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:42:11.459244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:42:11.461472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] PATH_INFO: `/v3/projects/5c1989f49646494687b8f84ad3368ce6` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:42:11.461472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1989f49646494687b8f84ad3368ce6)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:42:11.462160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:42:11.462160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:42:11.462160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:42:11.463049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:42:11.615463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1989f49646494687b8f84ad3368ce6', 'request_id': 'req-20ee029b-1b56-4e93-98d3-c831904f0e59'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:11.630177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1989f49646494687b8f84ad3368ce6', 'request_id': 'req-20ee029b-1b56-4e93-98d3-c831904f0e59'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:11.715089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1989f49646494687b8f84ad3368ce6', 'request_id': 'req-20ee029b-1b56-4e93-98d3-c831904f0e59'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:11.726069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] The token cache is being invalidate because project 5c1989f49646494687b8f84ad3368ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:42:11.726353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:11.727057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-20ee029b-1b56-4e93-98d3-c831904f0e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:42:11.728596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 751/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:42:11 2022] DELETE /identity/v3/projects/5c1989f49646494687b8f84ad3368ce6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:42:21.255031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:42:21.722969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:43:55.018676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:55.019174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:55.019278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:55.020666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:43:55.025407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183bb4-079a-47bc-b4ac-0d4ef3fe43d4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:55.025864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183bb4-079a-47bc-b4ac-0d4ef3fe43d4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:55.026009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183bb4-079a-47bc-b4ac-0d4ef3fe43d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:55.044276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3b183bb4-079a-47bc-b4ac-0d4ef3fe43d4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:43:55.045473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3b183bb4-079a-47bc-b4ac-0d4ef3fe43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:43:55.104510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:43:55.259362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:43:55.261295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:43:55.335827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457bd7c-0bb1-484c-b7f5-ec46499c21f5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:43:55.341889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:43:55.342516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:55.342803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:55.343083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:55.351298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:43:55.352908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aed872-0428-4716-925f-69c4f2bff60c service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:43:55.362263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 761/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:43:56.191712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639eca0-1732-446f-a722-5632af87623a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:56.192289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639eca0-1732-446f-a722-5632af87623a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:56.192289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639eca0-1732-446f-a722-5632af87623a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:56.193671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:43:56.199365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61aa91-5ee2-450a-b2a8-bf1aa80d4797 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:56.199800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61aa91-5ee2-450a-b2a8-bf1aa80d4797 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:56.199931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf61aa91-5ee2-450a-b2a8-bf1aa80d4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:56.219921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cf61aa91-5ee2-450a-b2a8-bf1aa80d4797 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:43:56.221138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cf61aa91-5ee2-450a-b2a8-bf1aa80d4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:43:56.229053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:43:56.381833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639eca0-1732-446f-a722-5632af87623a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:43:56.396821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639eca0-1732-446f-a722-5632af87623a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:43:56.402561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:43:56.403204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:56.403487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:56.403763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:56.412187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:43:56.413781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68a4e8-5266-4e55-b960-4ae7101c5402 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:43:56.423798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 754/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:43:57.814498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9abf3-5dec-47f3-ad36-fc19cacd546d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:57.815020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9abf3-5dec-47f3-ad36-fc19cacd546d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:57.815020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9abf3-5dec-47f3-ad36-fc19cacd546d None None] PATH_INFO: `/v3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:57.816283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 763/1517] 10.222.0.23 () {54 vars in 925 bytes} [Fri Jun 24 03:43:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:43:57.822746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c0a1-1c79-4dc5-8835-3734f37f44e8 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:43:57.823190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c0a1-1c79-4dc5-8835-3734f37f44e8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:43:57.823341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453c0a1-1c79-4dc5-8835-3734f37f44e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:43:57.842999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9453c0a1-1c79-4dc5-8835-3734f37f44e8 None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:43:57.844218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9453c0a1-1c79-4dc5-8835-3734f37f44e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:43:57.906524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 755/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Jun 24 03:43:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:02.026037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0202-655c-4d04-840c-e23193d9f35a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:02.026467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0202-655c-4d04-840c-e23193d9f35a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:02.026571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b0202-655c-4d04-840c-e23193d9f35a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:02.027896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 764/1519] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 03:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:02.032872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf822-307b-4bf3-87c3-6694bc492be6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:02.033296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf822-307b-4bf3-87c3-6694bc492be6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:02.033441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1cf822-307b-4bf3-87c3-6694bc492be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:02.051935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8e1cf822-307b-4bf3-87c3-6694bc492be6 None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:02.053163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8e1cf822-307b-4bf3-87c3-6694bc492be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:02.062359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 756/1520] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:02.069445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b0202-655c-4d04-840c-e23193d9f35a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:02.082656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b0202-655c-4d04-840c-e23193d9f35a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:02.088121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:02.088755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:02.089040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:02.089314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:02.097483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:02.099095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d17404-2d4b-43d0-bc1e-8ec55e1dfc65 service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:02.109310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 765/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:07.652293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c7be-39dc-4fc8-acfb-1fef22bddfc7 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:07.652755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c7be-39dc-4fc8-acfb-1fef22bddfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:07.652874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41c7be-39dc-4fc8-acfb-1fef22bddfc7 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:07.654316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:07.659159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f45c1-cc64-40d5-8da2-5a9f31b862f8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:07.659551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f45c1-cc64-40d5-8da2-5a9f31b862f8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:07.659735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f45c1-cc64-40d5-8da2-5a9f31b862f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:07.800212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7c1f45c1-cc64-40d5-8da2-5a9f31b862f8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:07.801445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7c1f45c1-cc64-40d5-8da2-5a9f31b862f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:07.809595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:07.965435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41c7be-39dc-4fc8-acfb-1fef22bddfc7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:07.980092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41c7be-39dc-4fc8-acfb-1fef22bddfc7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:07.985702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:07.986361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:07.986650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:07.986929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:07.995494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:07.997140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b430-6fdb-4b77-8a0c-68a0c18b03fa service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:08.007413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 758/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:08.823237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1530-1e4e-40f5-a3b2-5b7fc99d729a None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:08.823822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1530-1e4e-40f5-a3b2-5b7fc99d729a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:08.823822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c1530-1e4e-40f5-a3b2-5b7fc99d729a None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:08.825190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 03:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:08.830144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22c0e-eaa1-4a5b-bb6d-3bd14643d58d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:08.830591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22c0e-eaa1-4a5b-bb6d-3bd14643d58d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:08.830695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22c0e-eaa1-4a5b-bb6d-3bd14643d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:08.849393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c0c22c0e-eaa1-4a5b-bb6d-3bd14643d58d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:08.850625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c0c22c0e-eaa1-4a5b-bb6d-3bd14643d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:08.859003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 03:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:09.010670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1530-1e4e-40f5-a3b2-5b7fc99d729a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:09.024723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c1530-1e4e-40f5-a3b2-5b7fc99d729a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:09.030587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:09.031214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:09.031496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:09.031771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:09.039720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:09.041908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2b30-1c8c-4151-aa1d-a705bd657b6f service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:09.051191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 768/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:13.019159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:13.019697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:13.019697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:13.021093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:13.026866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0dfb-8eaf-47a9-be5b-8e39c371e18d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:13.027274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0dfb-8eaf-47a9-be5b-8e39c371e18d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:13.027423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d0dfb-8eaf-47a9-be5b-8e39c371e18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:13.045924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d03d0dfb-8eaf-47a9-be5b-8e39c371e18d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:13.047138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d03d0dfb-8eaf-47a9-be5b-8e39c371e18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:13.055036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:13.092009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:13.093718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:13.150777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200b142-f40d-4ef3-99b0-d440b145f09d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:13.154919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:13.155562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:13.155847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:13.156123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:13.165711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:13.167182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b921b-5bd0-4b4e-bc9d-9e593c64dd93 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:13.172691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:44:13.177530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 761/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:15.213626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dde98-03ac-4f5a-8476-f82e682afcf4 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:15.214283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dde98-03ac-4f5a-8476-f82e682afcf4 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:15.214283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dde98-03ac-4f5a-8476-f82e682afcf4 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:15.215623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:15.220957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce9a0-f2b1-42f5-af3b-557e4a17b8c3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:15.221400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce9a0-f2b1-42f5-af3b-557e4a17b8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:15.221556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ce9a0-f2b1-42f5-af3b-557e4a17b8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:15.240004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4c1ce9a0-f2b1-42f5-af3b-557e4a17b8c3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:15.241210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4c1ce9a0-f2b1-42f5-af3b-557e4a17b8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:15.249794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:15.285965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dde98-03ac-4f5a-8476-f82e682afcf4 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:15.297072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dde98-03ac-4f5a-8476-f82e682afcf4 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:15.300580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:15.301209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:15.301490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:15.301763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:15.311203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:15.312611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36cd2b-6f2c-4802-ae22-bf3619b827fb service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:15.321888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 771/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:18.787540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9681-2970-4d64-a772-aca7898622ab None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:18.788112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9681-2970-4d64-a772-aca7898622ab None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:18.788112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d9681-2970-4d64-a772-aca7898622ab None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:18.789655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:18.794657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9b2-7bdb-4714-b307-b36c892a330d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:18.795067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9b2-7bdb-4714-b307-b36c892a330d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:18.795209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656f9b2-7bdb-4714-b307-b36c892a330d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:18.813839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e656f9b2-7bdb-4714-b307-b36c892a330d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:18.815056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e656f9b2-7bdb-4714-b307-b36c892a330d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:18.822795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:19.123454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d9681-2970-4d64-a772-aca7898622ab None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:19.125145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-661d9681-2970-4d64-a772-aca7898622ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:19.181458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d9681-2970-4d64-a772-aca7898622ab None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:19.185596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:19.186259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:19.186547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:19.186823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:19.195723 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:19.197151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258c746-67a4-4ac9-92b7-7a33ed54f312 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:19.206687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 764/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:21.253138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:21.253657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:21.253657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:21.255223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 03:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:44:21.260742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a9298-5608-4c57-af90-b2feb4ee0ea1 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:21.261216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a9298-5608-4c57-af90-b2feb4ee0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:21.261345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a9298-5608-4c57-af90-b2feb4ee0ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:21.279426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-df4a9298-5608-4c57-af90-b2feb4ee0ea1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:44:21.280643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-df4a9298-5608-4c57-af90-b2feb4ee0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:21.288741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:44:21.590953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:44:21.592634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:44:21.600132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=65 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:44:21.606719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bd82d-2319-4499-a791-c81a83d01ee1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:44:21.610261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:44:21.616278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:44:21.616278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:44:21.616278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:44:21.620358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:44:21.621800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27037316-f179-4bf1-b8a0-a7cd880e5f9f service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:44:21.631102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 774/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:44:31.274167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=32 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:44:31.635842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:55.809349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:55.809968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:55.809968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:55.834875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:55.836555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:55.848818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 766/1540] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:45:55.859921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:55.860909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:55.861403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:55.890696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:55.892301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:55.906239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 775/1541] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:55.911526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:55.922423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8a46c-241c-4321-af92-0f22dc469383 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:55.930352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:55.931342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:55.931837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:55.932316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:55.933294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:55.933816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:55.936322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:55.955784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 767/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:55.964676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:55.983164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f486157-1d41-4750-ad1e-e969616f10c3 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:55.988690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:55.989765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:55.990299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:55.990916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:55.991846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.000996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e69b90-372c-4680-b019-4157f01b9361 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.138425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 776/1543] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:55 2022] POST /identity/v3/projects => generated 371 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:56.143613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.158607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41f57c-cd17-49ad-b3b9-0c8f568bd8cf admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.226051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f883-37fa-41a8-b521-30655eaa917c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.226680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f883-37fa-41a8-b521-30655eaa917c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.227191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f883-37fa-41a8-b521-30655eaa917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.272427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aad0f883-37fa-41a8-b521-30655eaa917c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.275568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aad0f883-37fa-41a8-b521-30655eaa917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.281871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.282941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.283424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.283898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.286194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.289199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2227b5-786d-4e44-a357-71cae5f01021 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.302978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 777/1544] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.304761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949dbc6-a968-457f-b6a6-61c08ea94bc9 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.305237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949dbc6-a968-457f-b6a6-61c08ea94bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.305768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949dbc6-a968-457f-b6a6-61c08ea94bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.338160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b949dbc6-a968-457f-b6a6-61c08ea94bc9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.339502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b949dbc6-a968-457f-b6a6-61c08ea94bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.356040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 778/1545] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.358347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4b98-6c74-4c19-bdf5-c3655dde51dc None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.358651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4b98-6c74-4c19-bdf5-c3655dde51dc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.358949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a4b98-6c74-4c19-bdf5-c3655dde51dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.384241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c64a4b98-6c74-4c19-bdf5-c3655dde51dc None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.392875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 768/1546] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:56.394567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d084a-f074-4dd4-ab03-8b1770b21080 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.394861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d084a-f074-4dd4-ab03-8b1770b21080 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.395224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d084a-f074-4dd4-ab03-8b1770b21080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.396658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c64a4b98-6c74-4c19-bdf5-c3655dde51dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.412889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 779/1547] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.418412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb338-a0ec-4ef0-80d3-58688b56d340 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.418412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb338-a0ec-4ef0-80d3-58688b56d340 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.418412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb338-a0ec-4ef0-80d3-58688b56d340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.422891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9f2d084a-f074-4dd4-ab03-8b1770b21080 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.424308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9f2d084a-f074-4dd4-ab03-8b1770b21080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.437893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 769/1548] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.438922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-131bb338-a0ec-4ef0-80d3-58688b56d340 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.439189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.439478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.439755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.441215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-131bb338-a0ec-4ef0-80d3-58688b56d340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.452543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 780/1549] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.453839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8106d5-caec-4dd2-a722-7d7467c22482 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.454177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8106d5-caec-4dd2-a722-7d7467c22482 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.454456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8106d5-caec-4dd2-a722-7d7467c22482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.461770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.463006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.471902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 770/1550] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.472578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.473836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0d8106d5-caec-4dd2-a722-7d7467c22482 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.475034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0d8106d5-caec-4dd2-a722-7d7467c22482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.482873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34af3a-b370-43df-b604-b3bc69480a29 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.483882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 781/1551] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.485270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.485720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.486019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.493910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.494588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.494873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.495150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.495914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.497549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8643f276-8a21-4f89-bd0e-0a12183ecc8b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.504296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.505484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.509402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 771/1552] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:56.510699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a367-1864-4ea0-8323-de1a17c2ea84 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.511111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a367-1864-4ea0-8323-de1a17c2ea84 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.511398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98a367-1864-4ea0-8323-de1a17c2ea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.515130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 782/1553] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.515977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.527165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddf60f-fdfb-4ca3-bcad-e06b7154326f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.529894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0a98a367-1864-4ea0-8323-de1a17c2ea84 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.531099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0a98a367-1864-4ea0-8323-de1a17c2ea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.532178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.532844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.533128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.533406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.534185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.534494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.535508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:45:56.535508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:45:56.535508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:45:56.536397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.539513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 772/1554] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.540836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3ec1-b386-45d7-bf89-548549386075 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.540836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3ec1-b386-45d7-bf89-548549386075 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.541147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e3ec1-b386-45d7-bf89-548549386075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.557808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 783/1555] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.557808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.561490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5b1e3ec1-b386-45d7-bf89-548549386075 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.562215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5b1e3ec1-b386-45d7-bf89-548549386075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.562822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fcdd1-8d9e-4343-af90-c03687271b5e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.567569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.568280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.568567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.568846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.569557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.569886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.570976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 773/1556] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.571470 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8d8b5-f6b8-4dfc-8982-dc5e9fb20a2f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.572298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.572592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.572873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.596416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 784/1557] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.596416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cfba-c43f-4c4a-9383-8c0c99dadcbd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.596416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cfba-c43f-4c4a-9383-8c0c99dadcbd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.596416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2cfba-c43f-4c4a-9383-8c0c99dadcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.596992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.596992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.601711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 774/1558] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.602524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.612481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ffa2cfba-c43f-4c4a-9383-8c0c99dadcbd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.612661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06af56c-f14a-4697-96bd-266416b822dd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.613682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ffa2cfba-c43f-4c4a-9383-8c0c99dadcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.617133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.617782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.618098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.618363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.619111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.620812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.621961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 785/1559] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.623893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.626493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.626493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.632016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 775/1560] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:56.632843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.642444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.642844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07220f8-8328-479a-8276-8bebdd4f186d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.643800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.647510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.648149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.648439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.648716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.649438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.649749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.651362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebe9f8-3c1b-41ba-8e59-56398ce025b7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.651920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 786/1561] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.653086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.663101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee59544e-a44f-44f5-b513-13066eaa0036 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.674742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 776/1562] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.674742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.674742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.674742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.682351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.682351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.682351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.682351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.682675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.682675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.686243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:56.687436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:56.695383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 777/1563] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:56.696121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.705295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d6938-7429-4e3a-b536-db01cb2c9ea1 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.709755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.710739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.710739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.710953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.711628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.712637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:45:56.712637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:45:56.712637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:45:56.713802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.768720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 787/1564] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:56.768720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.817145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 778/1565] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:56.818126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.828494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b00622-e6cf-4061-beb3-f9f96ecd39b7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.852308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:56.864791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:56.880430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35adff-5368-4ede-b597-2bae3dd8cb13 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.886864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.887525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.887811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.888038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.888150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.888701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.888796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.889057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.889167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.889342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.890102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.894344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.894486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.894595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.909718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 779/1566] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.909718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.910033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 788/1567] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.910033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.916738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47380ba2-2322-47db-a39f-4d19419b722b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.921076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32076c-732e-4cb4-90b8-b843f676b76c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.922206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.923174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.923461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.923740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] PATH_INFO: `/v3/projects/25a4c2833bda42bb852bdfaedd34d721/users/13615e8604a94751aab673b8d4537cf5/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.925966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.927371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.927371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.927371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.927851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:56.928159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.929766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.939403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a4c2833bda42bb852bdfaedd34d721, user_id=13615e8604a94751aab673b8d4537cf5, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.940501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:45:56.940501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:45:56.940501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:45:56.941815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 789/1568] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:56.942544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:56.942651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:56.952153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b01e3-f155-49de-a7a9-df8a8dd3acb5 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:56.957398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:56.959804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:56.959804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:56.959804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:56.959804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:56.961258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.044194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 780/1569] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:56 2022] PUT /identity/v3/projects/25a4c2833bda42bb852bdfaedd34d721/users/13615e8604a94751aab673b8d4537cf5/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:57.045041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.056999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 790/1570] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.057901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.112551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd6ff2-5243-446d-b51d-37b88c50c23f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.117331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.118028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.118314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.118594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.119320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:45:57.119626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9414a-2035-42ae-afec-84ad2e8a7468 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.119740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.121250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.124303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.124989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.125270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.125541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.126269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.127268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:45:57.127268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:45:57.127268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:45:57.128443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.132780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 781/1571] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:45:57.133541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.143530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34626617-7bef-4446-8d6f-ce001628aba7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.148200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.148788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.149072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.149347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.150066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.154968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.238064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 791/1572] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 296 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.238993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.246817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 782/1573] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 279 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.252290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.252413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d78add5-a650-4c55-b3f6-d69fced4a7aa admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.253064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.253751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.254599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.254895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.255624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.257515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.260149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f1f6-1f2f-444f-8406-e54b925293e3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.265711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.266389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.266677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.266952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.267634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.269531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412b1ed-db4b-4a25-956e-7903ace06c71 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.357759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 792/1574] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.358729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.368702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 783/1575] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.372910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.372910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.372910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.397530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] MFA Rules not processed for user `13615e8604a94751aab673b8d4537cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:57.398908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:57.421375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0641f818-5356-4202-8e67-0dcc6b2761e7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.428897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:57.443586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:57.462557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 784/1576] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:57.463357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.482174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.483199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.483481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.483767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.484447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.486383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.528078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e33e8-3e3d-48b6-aa5a-4f6ab9d512b7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.533229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.533926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.534208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.534483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.535169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.537116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.565071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 793/1577] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.565911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.627874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46e91-b93c-4171-9818-f89bbe6c76e5 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.632527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.633173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.633456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.633727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.634693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.636676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.650187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 785/1578] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.651002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.662345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acebebf1-4535-4008-b09f-92d9a4c9f2e7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.667588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.668248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.668533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.668810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.669534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.671873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.684671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 786/1579] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:57.684671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.691742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf494f-6ef4-4395-b9ca-0632543f04d1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.696306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.696902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.697187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.697462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.698209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.699786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.710092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 787/1580] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:57.710849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.720573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43784b-f676-46a0-838f-ae1e032d2c7f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.725066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.725676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.725988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.726267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.726936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.728784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.771291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 794/1581] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.772097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.823954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 788/1582] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.823954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.832669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1d55-22e0-4bb8-adb5-e960f7f3a69e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.833322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630d39a-e9c1-4fa7-b8a9-df859a7f0100 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.837468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.838143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.838429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.838706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.838837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.839401 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.839515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.839688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.839965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.840681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.841390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.843158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.917762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 795/1583] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.918516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.927711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f5864-ac62-4783-9965-1a08783ca637 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:57.932251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:57.932879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:57.933167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:57.933526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:57.934348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:57.936229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:57.944996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 789/1584] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:57.944996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:57.945807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:58.004217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 796/1585] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:57 2022] POST /identity/v3/users => generated 295 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:58.009374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.014964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a9c9e-a4f6-4d9f-a109-3a42f3fa3726 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.015964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe898ef-19c9-4f8b-97c2-8db0aff9092a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.019722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.020391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.020676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.020944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.021189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.021960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.022366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.022871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.023148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.023279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.023981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.025601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.034053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 790/1586] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.035021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.040574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 797/1587] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.041661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.044697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76902bbf-831f-42fe-98fa-9c6c8de432a0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.049891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.050137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.050420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.050701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.051423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.052997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.053136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb000d5-0271-4f82-986a-9455ce77b2c4 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.057660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.058330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.058610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.058727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:58.058890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.059547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.061437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.063889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 791/1588] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.064662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.074161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a253ff0-5159-49de-8ded-c26c3a79c866 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.079273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.079907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.080191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.080467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.081187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.082789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.094610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 792/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.095379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.104551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b14c6-4734-46bf-bdb6-2a6c4f2235a8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.109136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.109743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.110059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.113841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.113841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.113841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.122230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 793/1590] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.123042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.131442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 798/1591] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:58.132384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.139251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3506f-a242-4708-a085-e3473c9a9827 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.140138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.140797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.141088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.141369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.142091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.143528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f682fa-9008-44f2-a8b2-91b113a261ed admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.144192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.148174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.148818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.149098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.149568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.150312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.151875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.162774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 799/1592] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.163717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.173314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9e8ff-8858-4bdc-9bb9-5f919496fa2f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.177804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.181447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.181447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.181447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.181447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.181447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.191306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 800/1593] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.192041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.201035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ba8ea7-0bce-4ca9-a487-d7c737d12808 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.206294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.213773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.213773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.213773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] PATH_INFO: `/v3/projects/eadb7cd25b7544d883f125016f71b37c/users/9bd6f3beda094f9c9bd43862a296b30a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.222038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadb7cd25b7544d883f125016f71b37c, user_id=9bd6f3beda094f9c9bd43862a296b30a, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.224670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.237956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 794/1594] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:58 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:58.238745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.248507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dae44a-de6f-43ea-b62c-8463bf619567 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.253013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.253889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.254170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.254751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] PATH_INFO: `/v3/projects/fb637bdffe694c6d99f37aaf4a4e0c38/users/00d698d753cf4cc1b410f7a12325a00c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.270092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb637bdffe694c6d99f37aaf4a4e0c38, user_id=00d698d753cf4cc1b410f7a12325a00c, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.272783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.318468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 801/1595] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/eadb7cd25b7544d883f125016f71b37c/users/9bd6f3beda094f9c9bd43862a296b30a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.319305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.346629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 795/1596] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/fb637bdffe694c6d99f37aaf4a4e0c38/users/00d698d753cf4cc1b410f7a12325a00c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.350118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.381487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824e42b-9f2e-48b4-93f9-9b3ee0050e8a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.418996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f9f3f9-a8db-47f3-98d4-dc308e421669 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.423909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.424519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.424805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.425085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.425842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.427500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.437646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.437817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 796/1597] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.438534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.438634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.438922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.439254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.440030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.441820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.447810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebcddc-b6a6-4d0d-b559-424dc6177be2 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.452329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 802/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.453180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.453317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.454167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.454555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.454931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.455757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.457396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.462676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017775b7-7a0a-477c-aa55-452024c9fe17 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.467255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.467449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 797/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.467887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.468195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.468289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.468582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.469238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.470968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.478238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b333f8-2f32-4051-89a2-b8cfb7fd8787 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.484134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 803/1600] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.484134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.484369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.484369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.484369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.484369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] PATH_INFO: `/v3/projects/142662249337437ab58aa69811ad0a38/users/715bb36a29d743e1b8b0fbad427efcd5/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.491459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8ca67-4a6c-452c-94d0-789100771bbe admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.496081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.496713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.496994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.497265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.498527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.499482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] RBAC: Authorizing `identity:create_grant(project_id=142662249337437ab58aa69811ad0a38, user_id=715bb36a29d743e1b8b0fbad427efcd5, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.500127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb547e-29b7-405f-8b3c-159013fa1451 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.502122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.505518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:58.511485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 804/1601] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.516118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda814-f3de-41e7-8303-3efc26aa735d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.516118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda814-f3de-41e7-8303-3efc26aa735d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.516118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dda814-f3de-41e7-8303-3efc26aa735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.530878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-99dda814-f3de-41e7-8303-3efc26aa735d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:58.532087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-99dda814-f3de-41e7-8303-3efc26aa735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:58.539697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 805/1602] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:58.540912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.541198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.541479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.567447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] MFA Rules not processed for user `00d698d753cf4cc1b410f7a12325a00c`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:58.569599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 798/1603] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/142662249337437ab58aa69811ad0a38/users/715bb36a29d743e1b8b0fbad427efcd5/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.569743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:58.570611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.633177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:58.637234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f223ae-f18f-42f9-95a0-5a26ea4e662f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.638176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 806/1604] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:58.641943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.645065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.646008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.646291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.646563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] PATH_INFO: `/v3/projects/df012bbc54554a56bef75b8f9868a191/users/325c6326312a4664a785a1b6f15001b2/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.650884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85784a-aee6-4790-ab72-329dc6a4dc73 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.658052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.659323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.659974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.660332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] PATH_INFO: `/v3/projects/11935500e1cf4c749c6d3f77dbfa1146/users/0bd253c869e7428ca8765eeb8e8122f8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.662775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df012bbc54554a56bef75b8f9868a191, user_id=325c6326312a4664a785a1b6f15001b2, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.666492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.677839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=11935500e1cf4c749c6d3f77dbfa1146, user_id=0bd253c869e7428ca8765eeb8e8122f8, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.681134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.724199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 799/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/df012bbc54554a56bef75b8f9868a191/users/325c6326312a4664a785a1b6f15001b2/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.725201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.741405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 807/1606] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/11935500e1cf4c749c6d3f77dbfa1146/users/0bd253c869e7428ca8765eeb8e8122f8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.742323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.792754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e9349-2d09-4e27-9ce8-ac21e1d0403e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.804855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f845-2b44-4c97-9709-353abadf5a7d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.810405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.811923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.812232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.812510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] PATH_INFO: `/v3/projects/60ad914d35bd44b2b15f0c420d5fb878/users/f0d12edb8e754ddb9578226105d4fa6d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.828652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ad914d35bd44b2b15f0c420d5fb878, user_id=f0d12edb8e754ddb9578226105d4fa6d, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.831366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.853125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.853968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.854235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.854515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.855288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.856933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.867669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 800/1607] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:58.868437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.879158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebf7da7-ad02-4877-aee6-fb9b1335aedd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.884252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 808/1608] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/60ad914d35bd44b2b15f0c420d5fb878/users/f0d12edb8e754ddb9578226105d4fa6d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:58.885091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:58.931938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:58.944420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb52aa3-bec5-4a47-86be-31ef6614e386 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:58.946363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.947436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.947738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.948084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] PATH_INFO: `/v3/projects/c24010fdc53a4749899805bff8b9a4fa/users/9a3719c542074e3da114225b02fad0fb/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.949315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:58.950072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.950427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.950796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.964591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.964820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f38e12-62a5-4609-8600-c8ccc662ed53 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.967346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24010fdc53a4749899805bff8b9a4fa, user_id=9a3719c542074e3da114225b02fad0fb, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:58.970598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d483e38-27a7-4fb3-b220-509400671f8b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:58.977030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 809/1609] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:45:58.978326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:58.978618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:58.978897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:58.997528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:58.999719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.014294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 810/1610] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.014294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.023396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65622a6d-da5b-431e-8bac-3d9b84c2b717 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.023909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 801/1611] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:58 2022] PUT /identity/v3/projects/c24010fdc53a4749899805bff8b9a4fa/users/9a3719c542074e3da114225b02fad0fb/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:59.025219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fdd6-02fb-4fbb-b68e-5cd41757e598 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.025720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fdd6-02fb-4fbb-b68e-5cd41757e598 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.026039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3386fdd6-02fb-4fbb-b68e-5cd41757e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.038684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:59.044730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3386fdd6-02fb-4fbb-b68e-5cd41757e598 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.046186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3386fdd6-02fb-4fbb-b68e-5cd41757e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.091944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.093413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.093413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.093413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.094121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.096188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109749f-853b-44fc-9045-b70fea88f56e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.114076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 802/1612] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.115706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.116102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.116485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.135277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.136475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.144784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 803/1613] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.145357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.156278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562463d8-1ee2-4fab-81f3-31171992149a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.160816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.161720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.162049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.162432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] PATH_INFO: `/v3/projects/d9a85911845049f88727ce02a914133b/users/e89d905d5e074c9f81da927521638ed4/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.178296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9a85911845049f88727ce02a914133b, user_id=e89d905d5e074c9f81da927521638ed4, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.181000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.228293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 811/1614] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/projects => generated 355 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:59.230597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.231076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.231537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.249825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.251123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.252180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 804/1615] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:59 2022] PUT /identity/v3/projects/d9a85911845049f88727ce02a914133b/users/e89d905d5e074c9f81da927521638ed4/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:59.262122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.262122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.336421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 812/1616] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.337586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.351849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17d9890-92c0-4c12-8b25-ae8a8839e7f6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.352055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de48ae-d041-4d6b-8bfe-0c1c88edbc63 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.358546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.359999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.359999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.359999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.360974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.362611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.365662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.366421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.366770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.367115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.375150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 813/1617] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:59.376763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.378030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.379650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.387907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86b30f0-eb3f-4699-a2ef-44a9671097a9 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.390291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 805/1618] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:45:59.391169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.392507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.393345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.393724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.394097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.399660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d77b-9639-4b77-abf9-a1c374edb887 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.403674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.404414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.404764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.405112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.406183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.408010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.415399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.417247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391a1c7-0b08-4ac9-942d-dcb007f24930 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.423673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 814/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:45:59.428372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 806/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:45:59.430943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.431373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.431664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.431946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.446097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd295b1f-0506-4838-b9a2-52541dfd0394 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.455956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.458115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.458252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.459025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.460722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.466424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.471486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] MFA Rules not processed for user `e89d905d5e074c9f81da927521638ed4`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.472676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.562639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:59.578702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 807/1621] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.579708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.588013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 815/1622] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:45:59.588977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.596152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373d29e-8401-4202-b5b0-aea89c003fa0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.601057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.601306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f554a-bb70-4802-94d5-63d51be9dd18 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.601869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.602176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.602427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.606748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.609624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.610065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.610486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] PATH_INFO: `/v3/projects/c24010fdc53a4749899805bff8b9a4fa/users/9a3719c542074e3da114225b02fad0fb/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.613235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.613369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c24010fdc53a4749899805bff8b9a4fa, user_id=9a3719c542074e3da114225b02fad0fb, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.614930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.619406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b07734-1ac0-407c-aec1-2b7f2d69f8b5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.627039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 808/1623] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:45:59.627981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.630626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 816/1624] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:59 2022] PUT /identity/v3/projects/c24010fdc53a4749899805bff8b9a4fa/users/9a3719c542074e3da114225b02fad0fb/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:59.632145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aef9b-f748-452f-8ede-baa3bf1fa698 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.632504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aef9b-f748-452f-8ede-baa3bf1fa698 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.632654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6aef9b-f748-452f-8ede-baa3bf1fa698 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.634716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 817/1625] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 03:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:45:59.640468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980db64-edb3-472a-8ee8-99062a4a28c9 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.649163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443011f9-3901-483c-a323-70fc311b8594 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.649163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443011f9-3901-483c-a323-70fc311b8594 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.649163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443011f9-3901-483c-a323-70fc311b8594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.665554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:45:59.675230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-443011f9-3901-483c-a323-70fc311b8594 None None] MFA Rules not processed for user `9a3719c542074e3da114225b02fad0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.676454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-443011f9-3901-483c-a323-70fc311b8594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.744197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.745507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.747097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.747097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.747097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.748981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.756634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 818/1626] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:45:59.762194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 809/1627] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:59.770752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.780970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.781272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.781375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.785176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca2f13-a337-4e9e-bfdd-1db982539494 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.791078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.792231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.792657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:45:59.792800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.793460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] PATH_INFO: `/v3/projects/44291ee2ed2a4bf0bdedc852245c37da/users/84f797c8dc444b54a41bd7b60c52faf2/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.793905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:45:59.813000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44291ee2ed2a4bf0bdedc852245c37da, user_id=84f797c8dc444b54a41bd7b60c52faf2, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.816077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.891302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 810/1628] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:45:59 2022] PUT /identity/v3/projects/44291ee2ed2a4bf0bdedc852245c37da/users/84f797c8dc444b54a41bd7b60c52faf2/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:45:59.892238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.898005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 819/1629] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 03:45:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:45:59.900390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:45:59.913894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c473e58-b11b-4dd3-acd2-969c968c4b80 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.954888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d347e786-06fe-465c-87fa-34c613046c97 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:45:59.959016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.959835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.960198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.960548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.979687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:45:59.979687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:45:59.979687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:45:59.979687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:45:59.980980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:45:59.983260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:45:59.996033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 820/1630] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:45:59.997250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:00.074655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:00.076675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:00.088508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 811/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:00.089388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:00.096694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:00.103500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41adcc4f-bf4f-40dc-b5c3-b9abb5b88e10 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:00.105026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e48a45-08a4-4703-9fb4-d64ba936d348 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:00.108495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:00.109537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.110067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.110445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] PATH_INFO: `/v3/projects/44291ee2ed2a4bf0bdedc852245c37da/users/84f797c8dc444b54a41bd7b60c52faf2/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.112988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:00.114154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.114504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.114888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.120579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44291ee2ed2a4bf0bdedc852245c37da, user_id=84f797c8dc444b54a41bd7b60c52faf2, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:00.124567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7480049-4d28-4bfd-bd50-ab74b08f5d90 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:00.140003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 812/1632] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:00 2022] PUT /identity/v3/projects/44291ee2ed2a4bf0bdedc852245c37da/users/84f797c8dc444b54a41bd7b60c52faf2/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:00.149747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5137-5eff-42a9-98b3-763180aadd08 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.150102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5137-5eff-42a9-98b3-763180aadd08 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.150383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c5137-5eff-42a9-98b3-763180aadd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.187445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8b8c5137-5eff-42a9-98b3-763180aadd08 None None] MFA Rules not processed for user `84f797c8dc444b54a41bd7b60c52faf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:00.188900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8b8c5137-5eff-42a9-98b3-763180aadd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:00.225927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:00.228369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:00.243346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 821/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:45:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:00.324756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 813/1634] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:00.338929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:00.363793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66181-283b-4af6-b303-ac719b7bfa2d service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:00.411724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:00.512324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:00.513426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.514292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.514577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.533894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:00.535694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:00.560164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 822/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:00.901868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811507a-f82d-4c97-9c8b-91e775815343 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.902355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811507a-f82d-4c97-9c8b-91e775815343 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.902355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811507a-f82d-4c97-9c8b-91e775815343 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.903739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 814/1636] 10.222.0.42 () {54 vars in 961 bytes} [Fri Jun 24 03:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:00.911072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:00.923752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1d95a-1d20-4a9c-b56a-6a3e72dcbbe9 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:00.926731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee989c-cc37-48d5-9879-06daa90a2ccd None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.927025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee989c-cc37-48d5-9879-06daa90a2ccd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.927305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee989c-cc37-48d5-9879-06daa90a2ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.943333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:00.944002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:00.944315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:00.944567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:00.954535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a3ee989c-cc37-48d5-9879-06daa90a2ccd None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:00.955766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a3ee989c-cc37-48d5-9879-06daa90a2ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:01.078441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 815/1637] 10.222.0.42 () {58 vars in 1058 bytes} [Fri Jun 24 03:46:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:01.086265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def20-c64c-4e31-8859-347c57afd941 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.086696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def20-c64c-4e31-8859-347c57afd941 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.087079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1def20-c64c-4e31-8859-347c57afd941 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.090425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 816/1638] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 03:46:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:01.099027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59ba6-6513-4341-ab55-f061bfc135e8 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.099476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59ba6-6513-4341-ab55-f061bfc135e8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.100980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf59ba6-6513-4341-ab55-f061bfc135e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.113371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:01.116288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:01.123248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:01.129468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 823/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:01.135616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0cf59ba6-6513-4341-ab55-f061bfc135e8 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:01.137099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0cf59ba6-6513-4341-ab55-f061bfc135e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:01.150724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 817/1640] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:01.184103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:01.201533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c84f2dc-f6b8-4838-ae85-ecf697973b06 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:01.210965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:01.212820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.213886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.214080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.251192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:01.252327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16842f4a-c559-4964-a586-29b2cc1e2617 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:01.264571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 824/1641] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:01.434032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c53f-ae9a-4a0a-97ae-8f95a3e9128d None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.434323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c53f-ae9a-4a0a-97ae-8f95a3e9128d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.434602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01c53f-ae9a-4a0a-97ae-8f95a3e9128d None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.436606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 818/1642] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 03:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:46:01.442427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.443328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.443721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.463222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:01.464528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:01.475049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 825/1643] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:01.527498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c53f-ae9a-4a0a-97ae-8f95a3e9128d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:01.543025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01c53f-ae9a-4a0a-97ae-8f95a3e9128d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:01.546466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:01.547499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:01.548188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:01.548676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:01.563696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:01.566951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:01.586217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 819/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:01.782884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:01.853196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:02.059998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764751ca-3fdd-460e-9d9a-7ea4ad6e9372 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:02.059998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:02.059998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.059998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.061974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] PATH_INFO: `/v3/users/13615e8604a94751aab673b8d4537cf5` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.061974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13615e8604a94751aab673b8d4537cf5)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:02.061974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:02.063408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:02.063408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c607f-6326-46d3-8557-914bba879338 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:02.076308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:02.077403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.077811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.078208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] PATH_INFO: `/v3/users/e89d905d5e074c9f81da927521638ed4` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.081962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e89d905d5e074c9f81da927521638ed4)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:02.332120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: WARNING py.warnings [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:46:02.332120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: warnings.warn(msg) Jun 24 03:46:02.332120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: Jun 24 03:46:02.332120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:02.397653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13615e8604a94751aab673b8d4537cf5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.397653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13615e8604a94751aab673b8d4537cf5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.399702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13615e8604a94751aab673b8d4537cf5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.401875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13615e8604a94751aab673b8d4537cf5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.401875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4f16cd6-3ed2-4015-ba16-0093d8faf2e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13615e8604a94751aab673b8d4537cf5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.509674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 826/1645] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:01 2022] DELETE /identity/v3/users/13615e8604a94751aab673b8d4537cf5 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:02.514743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.515397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.515855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.519246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e89d905d5e074c9f81da927521638ed4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.551625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:02.553926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:02.558105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e89d905d5e074c9f81da927521638ed4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.626722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:02.642088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 827/1646] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:02.648472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e89d905d5e074c9f81da927521638ed4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.649116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e89d905d5e074c9f81da927521638ed4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.655837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:02.657684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:02.689962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-058322e4-99ad-4574-8320-51914bb14bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e89d905d5e074c9f81da927521638ed4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:02.689962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 820/1647] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:01 2022] DELETE /identity/v3/users/e89d905d5e074c9f81da927521638ed4 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:02.694008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.694303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.694584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.746559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:02.747812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:02.759297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91f3d0-d7e9-4969-a05d-fa619a8cd89f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:02.833732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:02.835420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.835420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.835420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.839133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:02.875546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 821/1648] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:02.892662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:02.895183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:02.929522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91abef-5896-4da3-958e-3b991bd05281 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:02.939836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:02.940992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:02.943447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:02.945254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:02.956909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:02.959705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:02.967572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:02.969034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:02.987932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 822/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:03.008722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 828/1650] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:04.296873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:04.299018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:04.322242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f83c5c-3619-4fee-aedd-84e54cbc246c service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:04.338921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:04.340151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:04.340761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:04.341370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] PATH_INFO: `/v3/projects/d9a85911845049f88727ce02a914133b` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:04.344323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9a85911845049f88727ce02a914133b)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:04.348646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:04.901746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9a85911845049f88727ce02a914133b', 'request_id': 'req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:04.903891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:04.912026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9a85911845049f88727ce02a914133b', 'request_id': 'req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:04.940205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:04.942779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:04.964250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df967b-4eef-4951-af4f-45a97b6be861 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:05.014336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9a85911845049f88727ce02a914133b', 'request_id': 'req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.033313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] The token cache is being invalidate because project d9a85911845049f88727ce02a914133b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:05.033956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.034863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f53d0f3c-b36f-4f2d-93d1-877bc9929bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.038600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 823/1651] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:04 2022] DELETE /identity/v3/projects/d9a85911845049f88727ce02a914133b => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:05.045869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6212d3-62de-48f7-9907-cc2595d3dd01 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.046466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6212d3-62de-48f7-9907-cc2595d3dd01 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.047262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6212d3-62de-48f7-9907-cc2595d3dd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.063871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:05.064934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.065219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.065483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] PATH_INFO: `/v3/projects/25a4c2833bda42bb852bdfaedd34d721` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.079748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a4c2833bda42bb852bdfaedd34d721)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:05.081609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: WARNING py.warnings [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 03:46:05.081609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: warnings.warn(msg) Jun 24 03:46:05.081609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: Jun 24 03:46:05.082871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:05.093028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-aa6212d3-62de-48f7-9907-cc2595d3dd01 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:05.094346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-aa6212d3-62de-48f7-9907-cc2595d3dd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:05.121662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 824/1652] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:05.130394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.131080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.131715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.167948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:05.170026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:05.183486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 825/1653] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:05.187863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:05.199051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7d864-8202-4f2b-aba0-4616fdeab5fb None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:05.219930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:05.221127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.221622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.222144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.223232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:05.223894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:05.226162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:05.227305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:05.265431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 826/1654] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:46:05.273161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:05.301826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d97f1-65fe-4c65-9f65-59d14fd47452 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:05.319915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a4c2833bda42bb852bdfaedd34d721', 'request_id': 'req-71d09d20-e297-4e08-b61a-e4722acea7b9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.340459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a4c2833bda42bb852bdfaedd34d721', 'request_id': 'req-71d09d20-e297-4e08-b61a-e4722acea7b9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.416521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a4c2833bda42bb852bdfaedd34d721', 'request_id': 'req-71d09d20-e297-4e08-b61a-e4722acea7b9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.467710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] The token cache is being invalidate because project 25a4c2833bda42bb852bdfaedd34d721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:05.468003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.469371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.474889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 829/1655] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:04 2022] DELETE /identity/v3/projects/25a4c2833bda42bb852bdfaedd34d721 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:05.479654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:05.486669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:05.506609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:05.509024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.509557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.509833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.511565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:05.516478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:05.635216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d09d20-e297-4e08-b61a-e4722acea7b9 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:05.668470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 827/1656] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:05 2022] POST /identity/v3/projects => generated 379 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:05.669720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:05.671778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:05.672692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.672981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.673264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] PATH_INFO: `/v3/users/9a3719c542074e3da114225b02fad0fb` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.679498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:05.683312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3719c542074e3da114225b02fad0fb)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:05.686195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:05.829298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f021f3-22c9-4aaf-81ee-8d7459518ca3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:05.840958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:05.842850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:05.843291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:05.843827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:05.844836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:05.847058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:05.977338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3719c542074e3da114225b02fad0fb'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:05.993720 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 828/1657] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:05 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:06.006385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3719c542074e3da114225b02fad0fb'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:06.010019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:06.027610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3719c542074e3da114225b02fad0fb'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:06.031441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3719c542074e3da114225b02fad0fb'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:06.033114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3719c542074e3da114225b02fad0fb'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:06.049613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d621188-ff56-42c0-aeab-af1f6cbac07a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:06.059994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:06.060871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.061069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.061343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.064603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:06.083527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:06.101758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 830/1658] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:05 2022] DELETE /identity/v3/users/9a3719c542074e3da114225b02fad0fb => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:06.108282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:06.109175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 829/1659] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:06.111349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:06.143990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:06.211762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718b1af-e2fd-46ba-95e8-a06750d07b65 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:06.218046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:06.219123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.219556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.219969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.220858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:06.222990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95343df1-37d0-453c-aac5-d9ab535823f1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:06.236543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 831/1660] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:06.240547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:06.276941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcd271-5979-46c8-9a6d-3d70d775d736 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:06.292466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:06.293530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.294107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.294457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] PATH_INFO: `/v3/projects/b187afb7de8c4e5abae83c9c7c537752/users/d7cf73c7a226437ba4533a2d10d3f3a1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.330887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b187afb7de8c4e5abae83c9c7c537752, user_id=d7cf73c7a226437ba4533a2d10d3f3a1, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:06.334580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:06.419692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 830/1661] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:06 2022] PUT /identity/v3/projects/b187afb7de8c4e5abae83c9c7c537752/users/d7cf73c7a226437ba4533a2d10d3f3a1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:06.431487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.431769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.432055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.505564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] MFA Rules not processed for user `d7cf73c7a226437ba4533a2d10d3f3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:06.506885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:06.695135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 832/1662] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:06.695913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:06.821636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b4487-076f-4401-a8be-5fc03a539724 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:06.829837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:06.830366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.830856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.831272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.832131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:06.835721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:06.876141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:06.876141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:06.932918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f337e-bad6-4afd-89f7-8f061c00b01e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:06.948022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:06.950204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:06.950204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:06.950204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] PATH_INFO: `/v3/projects/c24010fdc53a4749899805bff8b9a4fa` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:06.951921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c24010fdc53a4749899805bff8b9a4fa)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:06.954437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.001470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 831/1663] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:06 2022] POST /identity/v3/projects => generated 381 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:07.007094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.187062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad66f9-3ab2-4f52-b9a0-0df34d2a0140 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.196357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24010fdc53a4749899805bff8b9a4fa', 'request_id': 'req-661a8796-d60d-436a-8359-0124cffb3c31'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:07.219171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24010fdc53a4749899805bff8b9a4fa', 'request_id': 'req-661a8796-d60d-436a-8359-0124cffb3c31'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:07.316090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:07.316842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.317130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.317726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.318306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:07.320768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.329182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24010fdc53a4749899805bff8b9a4fa', 'request_id': 'req-661a8796-d60d-436a-8359-0124cffb3c31'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:07.368846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] The token cache is being invalidate because project c24010fdc53a4749899805bff8b9a4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:07.369360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:07.371246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-661a8796-d60d-436a-8359-0124cffb3c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:07.377144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 833/1664] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:06 2022] DELETE /identity/v3/projects/c24010fdc53a4749899805bff8b9a4fa => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:07.382562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d957-8192-4d2a-a939-7fcd64d23d2e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.382853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d957-8192-4d2a-a939-7fcd64d23d2e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.383177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841d957-8192-4d2a-a939-7fcd64d23d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.421021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a841d957-8192-4d2a-a939-7fcd64d23d2e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:07.422600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a841d957-8192-4d2a-a939-7fcd64d23d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:07.444186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 834/1665] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:07.446005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.446454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.446879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.475610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:07.477341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:07.489017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 835/1666] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:07.495238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.505910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 832/1667] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:07 2022] POST /identity/v3/users => generated 297 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:07.510940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccec856-1311-40c9-8ec1-aa03e2997cab None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.516201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.517296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:07.518479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.518825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.519113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.519716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:07.519912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:07.520231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:07.522234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.543855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 836/1668] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:07.545647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.570925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54870e1-8567-4c37-ae6e-699c4ce3f50b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.576560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342b942-b44f-412b-95b4-9f66d6106965 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.585771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:07.586485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.586771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.587234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.588234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:07.590240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.596342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:07.597248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.597693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.598148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.599031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:07.601229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.644575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 833/1669] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:07.649986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.672306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:07.673003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146ea2f-0f2c-47ce-8e95-fe323a0f3916 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.682375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:07.683683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:07.684248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:07.684679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] PATH_INFO: `/v3/projects/203448469cc340f186efacd48868ca5d/users/071b8abf87bf47dcbf15b45c75ab44d9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:07.713165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] RBAC: Authorizing `identity:create_grant(project_id=203448469cc340f186efacd48868ca5d, user_id=071b8abf87bf47dcbf15b45c75ab44d9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:07.716105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:07.723092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 837/1670] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:07 2022] POST /identity/v3/projects => generated 365 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:07.727250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.799411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 834/1671] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:07 2022] PUT /identity/v3/projects/203448469cc340f186efacd48868ca5d/users/071b8abf87bf47dcbf15b45c75ab44d9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:07.800464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:07.910043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2402d-0058-4a8f-875b-eca86130ed8c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:07.996880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd1d2-a55a-41e5-b1fb-f11f94f5dedb admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.014793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.018530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.019164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.021382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.023171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.026284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.064661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 835/1672] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:08.069686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:08.095609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fb500-3d40-4b3e-916c-4d33e327b975 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.109602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.111354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.112078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.112635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.112769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.113389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] PATH_INFO: `/v3/projects/203448469cc340f186efacd48868ca5d/users/071b8abf87bf47dcbf15b45c75ab44d9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.114796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.115231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.119828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=203448469cc340f186efacd48868ca5d, user_id=071b8abf87bf47dcbf15b45c75ab44d9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.124989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94782ad-37d7-4e56-9553-8f7f52131d9c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.130883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.137594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.158041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 836/1673] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:08 2022] PUT /identity/v3/projects/203448469cc340f186efacd48868ca5d/users/071b8abf87bf47dcbf15b45c75ab44d9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:08.168624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.169029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.169569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.234522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] MFA Rules not processed for user `071b8abf87bf47dcbf15b45c75ab44d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:08.240348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:08.310768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 838/1674] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:07 2022] POST /identity/v3/users => generated 283 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:08.317933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:08.338238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973c54-761f-40d0-8ce8-20dda6a9b618 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.413630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:08.429833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 837/1675] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:08.441634 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:08.444756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:08.496321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.498199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.498662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.498953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.499716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.503681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.530530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 839/1676] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:08.531530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:08.556411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3430e025-8a23-4a0f-b361-c2d4ea083941 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.558440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2788871-5672-4a2d-b467-61b96d32eb1b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.560981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.561704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.562022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.562307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.571036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.573631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.573955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.574236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.574510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.574977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.576746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.577108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb04b4-f8d3-4c2a-9712-d3cfad04dddb admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.589828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 838/1677] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:08.602970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 840/1678] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:08.607751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:08.628999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fde80-67d7-4380-be3e-2a6ba8d6bf9f service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:08.640704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:08.642151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.642649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.643203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] PATH_INFO: `/v3/projects/961dc9c00a1b4bbe927ed7f6c10fe937/users/028f2c63a838452c86ff8258a4d7898d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.673760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] RBAC: Authorizing `identity:create_grant(project_id=961dc9c00a1b4bbe927ed7f6c10fe937, user_id=028f2c63a838452c86ff8258a4d7898d, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:08.676991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:08.763136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 839/1679] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:08 2022] PUT /identity/v3/projects/961dc9c00a1b4bbe927ed7f6c10fe937/users/028f2c63a838452c86ff8258a4d7898d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:08.775962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:08.781647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:08.781647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:08.838252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] MFA Rules not processed for user `028f2c63a838452c86ff8258a4d7898d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:08.838252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:09.028413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 841/1680] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:09.034760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:09.154183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:09.233266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c8388-1e69-488a-90d3-278ea42c406c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:09.278414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:09.280063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:09.280633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:09.281066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:09.282283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:09.284369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:09.286834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:09.308874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f4a1d-b939-4415-98c5-1769a9582805 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:09.316030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:09.321416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:09.321416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:09.321416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:09.323716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:09.439962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 840/1681] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:09 2022] POST /identity/v3/projects => generated 363 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:09.443398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:09.444966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:09.445162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:09.458646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 842/1682] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:09.642784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d18be-659d-4f78-bb81-e36fa39bfb37 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:09.647690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:09.648416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:09.648769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:09.649383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:09.650179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:09.655232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:09.798640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 841/1683] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:09 2022] POST /identity/v3/users => generated 288 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:09.802063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:09.816819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b639f03-879b-4e50-a925-a0481c29e591 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:09.832154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:09.832847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:09.833132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:09.833411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:09.834171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:09.836161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:09.855926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 843/1684] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:09.858010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:09.872512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147724e1-ceb3-401b-95f2-9ddec53cc054 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:09.881119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:09.898750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:09.902148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:09.904877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] PATH_INFO: `/v3/projects/2f1b700135134e25bd868d9732397af2/users/5ee4829f982245d79af01a7f832bd522/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:09.930487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1b700135134e25bd868d9732397af2, user_id=5ee4829f982245d79af01a7f832bd522, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:09.936593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:10.054409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 842/1685] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:09 2022] PUT /identity/v3/projects/2f1b700135134e25bd868d9732397af2/users/5ee4829f982245d79af01a7f832bd522/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:10.059246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:10.072606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065a5c4-b725-4aca-a4c3-1e3fae3004f8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:10.182385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:10.183361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:10.184046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:10.184469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:10.186064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:10.188010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e2bfb5-da25-42a1-a5dc-15d53f4b165a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:10.202021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 844/1686] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:10.206454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:10.220474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aacd024-4992-4cf7-bc98-fbb2e925d76b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:10.231757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:10.232709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:10.232993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:10.233349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] PATH_INFO: `/v3/projects/2f1b700135134e25bd868d9732397af2/users/5ee4829f982245d79af01a7f832bd522/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:10.236281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1b700135134e25bd868d9732397af2, user_id=5ee4829f982245d79af01a7f832bd522, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:10.242414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:10.266366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 843/1687] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:10 2022] PUT /identity/v3/projects/2f1b700135134e25bd868d9732397af2/users/5ee4829f982245d79af01a7f832bd522/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:10.279938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:10.280116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:10.280355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:10.334227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] MFA Rules not processed for user `5ee4829f982245d79af01a7f832bd522`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:10.335486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:10.486221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 845/1688] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:10.500828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:10.566510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac48d4-0fe0-4f67-8d6e-127b9419d148 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:10.571128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:10.571381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:10.571721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:10.572004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:10.583926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:10.585824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd5c46-4998-4407-b3fe-b3b9e35bc94d service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:10.603288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 844/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:10.667389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:10.861738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:10.863548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:10.887865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5799663d-1666-48de-88a2-a5b6e5cff2ca None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:10.900281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:10.900956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:10.901232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:10.901511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:11.011946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:11.074402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:11.078745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330173e0-dd5e-4ea4-946a-2d68d71aeb05 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:11.115430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 846/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:12.194846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:12.195626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:12.196075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:12.269667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] MFA Rules not processed for user `9bd6f3beda094f9c9bd43862a296b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:12.278329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:12.402297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 845/1691] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:12.415286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47bf9d-bd83-48b9-97cb-f2b71d25a0bf None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:12.415770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47bf9d-bd83-48b9-97cb-f2b71d25a0bf None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:12.415943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47bf9d-bd83-48b9-97cb-f2b71d25a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:12.477652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aa47bf9d-bd83-48b9-97cb-f2b71d25a0bf None None] MFA Rules not processed for user `9bd6f3beda094f9c9bd43862a296b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:12.479007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aa47bf9d-bd83-48b9-97cb-f2b71d25a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:12.495305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 847/1692] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:12.508432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:12.510681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:12.646793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6f87c-85e9-4c8e-8ae7-46860c967cd4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:12.661283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:12.662061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:12.662280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:12.662605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:12.681619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:12.683354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ce938-c355-4c5e-a35b-d7b606d17d2c service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:12.694763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 846/1693] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:12.729829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:13.192437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:13.760673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:13.761194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:13.761453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:13.763421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 848/1694] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 03:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:13.777395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b717-71ce-46c8-b28f-c7a9247c5621 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:13.777940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b717-71ce-46c8-b28f-c7a9247c5621 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:13.778166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6161b717-71ce-46c8-b28f-c7a9247c5621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:13.866097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6161b717-71ce-46c8-b28f-c7a9247c5621 None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:13.867507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6161b717-71ce-46c8-b28f-c7a9247c5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:13.985448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 847/1695] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:46:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:13.997323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:14.000568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:14.039796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cc3f3-0c78-4498-af3c-e950173ba2fe None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:14.044375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:14.046020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:14.046535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:14.047073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:14.057803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:14.059507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3051f175-b2e1-4e77-8dde-01c26a9f1087 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:14.069202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 849/1696] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:14.927764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5658-b2d5-4d11-a0f6-1d5deafb96c1 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:14.931620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5658-b2d5-4d11-a0f6-1d5deafb96c1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:14.933119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5658-b2d5-4d11-a0f6-1d5deafb96c1 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:14.938667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 848/1697] 10.222.0.42 () {54 vars in 960 bytes} [Fri Jun 24 03:46:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:14.952680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1283a-78b5-4579-b3dc-952f356fd208 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:14.953541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1283a-78b5-4579-b3dc-952f356fd208 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:14.953981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1283a-78b5-4579-b3dc-952f356fd208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:15.047900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d8e1283a-78b5-4579-b3dc-952f356fd208 None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:15.047900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d8e1283a-78b5-4579-b3dc-952f356fd208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:15.061224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:15.061519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:15.061790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:15.124361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:15.126866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] MFA Rules not processed for user `9bd6f3beda094f9c9bd43862a296b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:15.131367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:15.162890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 849/1698] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:15.175958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:15.345920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 850/1699] 10.222.0.42 () {58 vars in 1057 bytes} [Fri Jun 24 03:46:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:15.352443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:15.379552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e699724-8166-402f-93c6-32619b3a42ff None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:15.401170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:15.416684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:15.417122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:15.420523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:15.430724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:15.458427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:15.460582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4defe-ccb3-4b4d-9c71-3b1781102583 service placement] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:15.502981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 850/1700] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:19.865459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:19.865459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:19.867926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:19.967263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] MFA Rules not processed for user `325c6326312a4664a785a1b6f15001b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:19.968854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:20.227285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 851/1701] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:20.239627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13495-47b8-4935-a51b-6d8a31894c85 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:20.241050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13495-47b8-4935-a51b-6d8a31894c85 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:20.241544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a13495-47b8-4935-a51b-6d8a31894c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:20.310921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-30a13495-47b8-4935-a51b-6d8a31894c85 None None] MFA Rules not processed for user `325c6326312a4664a785a1b6f15001b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:20.316769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-30a13495-47b8-4935-a51b-6d8a31894c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:20.378827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:20.380450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:20.391896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 851/1702] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:20.431617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4062b-7d32-4c17-8154-1631da718aac None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:20.461626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:20.462361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:20.462644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:20.462919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:20.500407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:20.502322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:20.540609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 852/1703] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:20.931763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315cb8-3512-4ca3-917f-ba31d8269bd6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:20.932101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315cb8-3512-4ca3-917f-ba31d8269bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:20.933986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315cb8-3512-4ca3-917f-ba31d8269bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:20.993700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3e315cb8-3512-4ca3-917f-ba31d8269bd6 None None] MFA Rules not processed for user `f0d12edb8e754ddb9578226105d4fa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:20.997688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3e315cb8-3512-4ca3-917f-ba31d8269bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:21.190628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 852/1704] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:21.274508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:21.314314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aecab-b3f2-48cc-9d5b-3262f4c18a53 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:21.336989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:21.338786 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:21.339079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:21.339359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:21.364566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:21.374847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b63958-c053-43d8-90e1-cd3ee617571d service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:21.410287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 853/1705] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:21.581883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8144-8d7d-4ba0-b53e-19eb81afb3df None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:21.582451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8144-8d7d-4ba0-b53e-19eb81afb3df None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:21.582451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8144-8d7d-4ba0-b53e-19eb81afb3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:21.717642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0b3e8144-8d7d-4ba0-b53e-19eb81afb3df None None] MFA Rules not processed for user `715bb36a29d743e1b8b0fbad427efcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:21.721109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0b3e8144-8d7d-4ba0-b53e-19eb81afb3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:21.805231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:21.805531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:21.806124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:21.854212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:21.855462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:22.009044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 854/1706] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:22.097447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 853/1707] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 516 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:22.102753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:22.140205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043662fa-cbce-40f9-b18e-14ac0cfbff1c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:22.182639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.183153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.183617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.204394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:22.205336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.205782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.206414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.223347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:22.226942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:22.233239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:22.254392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] MFA Rules not processed for user `0bd253c869e7428ca8765eeb8e8122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:22.261987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 855/1708] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:22.262513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:22.412094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 854/1709] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:22.480174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:22.529117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:22.530729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:22.545599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:22.654916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513851da-cbc7-40e1-a8a8-3762a4d95dc5 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:22.666249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:22.672256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.673925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.675046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] PATH_INFO: `/v3/users/d7cf73c7a226437ba4533a2d10d3f3a1` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.676723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7cf73c7a226437ba4533a2d10d3f3a1)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:22.681054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:22.708032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfd5cf-a1f7-46c1-9860-09debb36a8e3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:22.732687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:22.733785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.734283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.734762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.748949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:22.752468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75081415-ffa7-4e52-ac3f-156b88d24ba1 service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:22.766749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 855/1710] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:46:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 03:46:22.769650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8576fd-0a4e-4f33-80d3-1edfd1ab5a6e None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.770026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8576fd-0a4e-4f33-80d3-1edfd1ab5a6e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.770781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8576fd-0a4e-4f33-80d3-1edfd1ab5a6e None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.801259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 856/1711] 10.222.0.42 () {54 vars in 912 bytes} [Fri Jun 24 03:46:22 2022] GET /identity => generated 270 bytes in 34 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:22.804226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:22.807242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:22.807728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:22.840552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:22.842503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:22.866920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 857/1712] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:46:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:22.956668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7cf73c7a226437ba4533a2d10d3f3a1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:22.991757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7cf73c7a226437ba4533a2d10d3f3a1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:23.016846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7cf73c7a226437ba4533a2d10d3f3a1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:23.024067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7cf73c7a226437ba4533a2d10d3f3a1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:23.024067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7cf73c7a226437ba4533a2d10d3f3a1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:23.068210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:23.088519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fd7f-88b3-4142-b49c-76fb8fde8912 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:23.105772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:23.113951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:23.116873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:23.117325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:23.127503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.130915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 856/1713] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:22 2022] DELETE /identity/v3/users/d7cf73c7a226437ba4533a2d10d3f3a1 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:23.139835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:23.139835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.158846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:23.160317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a369585-d8f0-4f82-87e8-3271a31cb787 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:23.190651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 858/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:23.195291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:23.195584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:23.195863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:23.316240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:23.322308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.404713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02ecd1-6ccd-41e2-8a4a-ed94386916de admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:23.424491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170720-815b-4b3c-a782-34797edac739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:23.455824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170720-815b-4b3c-a782-34797edac739 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:23.455824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170720-815b-4b3c-a782-34797edac739 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:23.455824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65170720-815b-4b3c-a782-34797edac739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:23.455824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-65170720-815b-4b3c-a782-34797edac739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.485118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 859/1715] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:23.565933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:23.578643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:23.589521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.627690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65170720-815b-4b3c-a782-34797edac739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:23.629648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65170720-815b-4b3c-a782-34797edac739 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:23.632789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:23.690488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 857/1716] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:23.710224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170720-815b-4b3c-a782-34797edac739 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:23.714591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-65170720-815b-4b3c-a782-34797edac739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:23.745963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c896a24-3f67-4f55-a491-594ae6fdcb78 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:23.755074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65170720-815b-4b3c-a782-34797edac739 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:23.758262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:23.759808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:23.761053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:23.761495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] PATH_INFO: `/v3/users/028f2c63a838452c86ff8258a4d7898d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:23.761625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:23.762463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:23.762787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:23.763144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:23.764894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028f2c63a838452c86ff8258a4d7898d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:23.768265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:23.844217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:23.849281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063bd820-b6dd-4d2c-9c52-e305b36a0dba service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:23.914361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 860/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:24.118134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028f2c63a838452c86ff8258a4d7898d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:24.137326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028f2c63a838452c86ff8258a4d7898d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:24.147842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028f2c63a838452c86ff8258a4d7898d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:24.148949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028f2c63a838452c86ff8258a4d7898d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:24.149818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028f2c63a838452c86ff8258a4d7898d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:24.253046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 858/1718] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:23 2022] DELETE /identity/v3/users/028f2c63a838452c86ff8258a4d7898d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:24.254428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:24.254724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:24.255004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:24.315104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:24.318052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:24.551569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 861/1719] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:24.605175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:24.613902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:24.805231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe9cd-e8a1-4234-81c4-748cbcf5a203 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:24.817754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:24.817754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:24.817754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:24.820476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:24.846112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:24.851431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd65db3-5bc5-4f7a-a4c8-6fa112320b45 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:24.914370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 859/1720] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:27.394116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:27.396337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:27.409381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:27.409919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:27.410003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:27.437112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01915e39-0575-4fa2-8245-68b7b2bdd79d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:27.463085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:27.463085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:27.464199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:27.478588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:27.479101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:27.483506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] PATH_INFO: `/v3/projects/b187afb7de8c4e5abae83c9c7c537752` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:27.486493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b187afb7de8c4e5abae83c9c7c537752)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:27.488987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:27.505354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 860/1721] 10.222.0.23 () {58 vars in 1015 bytes} [Fri Jun 24 03:46:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:27.530364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:27.531824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:27.577107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78387e-1025-442b-bf36-872c173c4f3e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:27.609503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:27.610946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:27.612717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:27.613797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:27.655767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:27.660876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:27.748929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 861/1722] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:27.777232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b187afb7de8c4e5abae83c9c7c537752', 'request_id': 'req-6a586c82-54a1-41a9-9480-e9d0b9ce7040'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:27.802688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b187afb7de8c4e5abae83c9c7c537752', 'request_id': 'req-6a586c82-54a1-41a9-9480-e9d0b9ce7040'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:27.876633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:27.878519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:27.917376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64607b4-7222-444f-a2ab-3ebe12cb79f7 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:27.978360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:28.036710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:28.038671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:28.042541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:28.043237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] PATH_INFO: `/v3/projects/961dc9c00a1b4bbe927ed7f6c10fe937` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:28.045887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961dc9c00a1b4bbe927ed7f6c10fe937)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:28.062050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:28.208127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b187afb7de8c4e5abae83c9c7c537752', 'request_id': 'req-6a586c82-54a1-41a9-9480-e9d0b9ce7040'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.239974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] The token cache is being invalidate because project b187afb7de8c4e5abae83c9c7c537752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:28.355092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.355092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.355092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 862/1723] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:27 2022] DELETE /identity/v3/projects/b187afb7de8c4e5abae83c9c7c537752 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:28.356699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:28.370398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:28.394169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a586c82-54a1-41a9-9480-e9d0b9ce7040 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:28.412722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:28.413626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:28.413959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:28.414315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] PATH_INFO: `/v3/users/071b8abf87bf47dcbf15b45c75ab44d9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:28.416157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=071b8abf87bf47dcbf15b45c75ab44d9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:28.418313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:28.553272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961dc9c00a1b4bbe927ed7f6c10fe937', 'request_id': 'req-26fcd6be-141f-4366-93b1-dea93bd101c6'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.570466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961dc9c00a1b4bbe927ed7f6c10fe937', 'request_id': 'req-26fcd6be-141f-4366-93b1-dea93bd101c6'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.691318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:28.691537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961dc9c00a1b4bbe927ed7f6c10fe937', 'request_id': 'req-26fcd6be-141f-4366-93b1-dea93bd101c6'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.718379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '071b8abf87bf47dcbf15b45c75ab44d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.734156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] The token cache is being invalidate because project 961dc9c00a1b4bbe927ed7f6c10fe937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:28.735499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.738838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.751100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 862/1724] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:27 2022] DELETE /identity/v3/projects/961dc9c00a1b4bbe927ed7f6c10fe937 => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:28.756013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:28.756167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '071b8abf87bf47dcbf15b45c75ab44d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.761764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:28.879119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '071b8abf87bf47dcbf15b45c75ab44d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.887060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '071b8abf87bf47dcbf15b45c75ab44d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.915607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '071b8abf87bf47dcbf15b45c75ab44d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:28.933482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 863/1725] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:28 2022] DELETE /identity/v3/users/071b8abf87bf47dcbf15b45c75ab44d9 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:28.940708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:28.946526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:29.138610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd6be-141f-4366-93b1-dea93bd101c6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:29.232151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b2e02-74cc-470d-ab9b-8e138172eaab admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:29.251729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:29.252718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:29.253005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:29.253405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] PATH_INFO: `/v3/users/00d698d753cf4cc1b410f7a12325a00c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:29.272641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d698d753cf4cc1b410f7a12325a00c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:29.276514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:29.426695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:29.436203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:29.436607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:29.436901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] PATH_INFO: `/v3/users/5ee4829f982245d79af01a7f832bd522` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:29.441662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee4829f982245d79af01a7f832bd522)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:29.452227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:29.687120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d698d753cf4cc1b410f7a12325a00c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.711481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d698d753cf4cc1b410f7a12325a00c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.776727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee4829f982245d79af01a7f832bd522'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.800916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d698d753cf4cc1b410f7a12325a00c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.801341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d698d753cf4cc1b410f7a12325a00c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.825293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee4829f982245d79af01a7f832bd522'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.827252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-9e418508-0ad7-40b4-abb6-c09e0d8ef89e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d698d753cf4cc1b410f7a12325a00c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.858988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee4829f982245d79af01a7f832bd522'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.858988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee4829f982245d79af01a7f832bd522'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.858988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee4829f982245d79af01a7f832bd522'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:29.861638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 864/1726] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:28 2022] DELETE /identity/v3/users/00d698d753cf4cc1b410f7a12325a00c => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:29.864189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:29.864750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:29.865180 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:29.952343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:29.966546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:30.006704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 863/1727] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:28 2022] DELETE /identity/v3/users/5ee4829f982245d79af01a7f832bd522 => generated 0 bytes in 1252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:30.189719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 865/1728] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:30.265298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:30.268665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:30.566376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c12fee-d505-4be3-bf87-7c9d11462f6d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:30.590238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:30.590961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:30.591244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:30.591525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:30.882755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:30.887063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746716b4-395c-4f7f-8c98-b392b432777d service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:30.920275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 864/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:31.045672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:31.050292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:31.098230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7e6db-a673-4b65-8383-05d337a620d4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:31.117541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:31.121486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:31.122067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:31.123462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] PATH_INFO: `/v3/projects/203448469cc340f186efacd48868ca5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:31.144163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=203448469cc340f186efacd48868ca5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:31.150909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:31.451185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203448469cc340f186efacd48868ca5d', 'request_id': 'req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:31.485682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203448469cc340f186efacd48868ca5d', 'request_id': 'req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:31.555447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:31.764068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203448469cc340f186efacd48868ca5d', 'request_id': 'req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:31.781677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] The token cache is being invalidate because project 203448469cc340f186efacd48868ca5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:31.782036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:31.786323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bb1d7d22-c6b6-46e2-be3d-5268fe197c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:31.794663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:31.797960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:31.797960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:31.798170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 866/1730] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:31 2022] DELETE /identity/v3/projects/203448469cc340f186efacd48868ca5d => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:31.832049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:31.836822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:31.979198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 865/1731] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:31.988092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:31.988314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:31.988596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.024006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:32.027397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:32.057196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 867/1732] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:32.060674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.083397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9d18-cb6d-43ec-bee6-0ef46c2ffddd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.100774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.101506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.101790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.102151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.102961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:32.103345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.106146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.131913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 866/1733] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:32.136447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.150891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a429f4-1397-4937-8364-873a1ab36290 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.158175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.160354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.160880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.161371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.162359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.166393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.189391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:32.281943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 868/1734] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:32 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:32.286339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.301333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96424c-7f12-439b-9422-7827a5ebc59d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.411083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.411913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.412226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.412739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.413619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.416251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d08dd-81f4-4ab1-ac29-f80cc224d3b4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.542365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 867/1735] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:32 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:32.547521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.585787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7301a-84e9-4c0b-9187-b57f137073bf None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.586181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7301a-84e9-4c0b-9187-b57f137073bf None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.586396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7301a-84e9-4c0b-9187-b57f137073bf None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.588005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 868/1736] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 03:46:32.590278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febfdf7-7480-4a4c-b968-ba31041da767 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.620985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.620985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.620985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.620985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.621287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.621287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.622082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dc60-04e8-4d83-891d-9657caeb64cc None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.622082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dc60-04e8-4d83-891d-9657caeb64cc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.622082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11dc60-04e8-4d83-891d-9657caeb64cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.645886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aa11dc60-04e8-4d83-891d-9657caeb64cc None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:32.650519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aa11dc60-04e8-4d83-891d-9657caeb64cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:32.693562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 869/1737] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:32.708895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.741683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f2a30-ac9f-4e37-9c32-f3e5db387fbd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.758612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.759565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.759854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.760160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.761067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.774517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.833907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 870/1738] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:32.834451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:32.859971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 869/1739] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:46:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:32.875966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d32a6b-62ae-4961-8fce-abf2f3e051c9 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:32.900741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:32.900741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:32.900741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:32.900741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] PATH_INFO: `/v3/projects/cd6fb43bfd654ba69eed1a5478f4261f/users/d120e3a1097648d59e4e023d26ddc00b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:32.918059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6fb43bfd654ba69eed1a5478f4261f, user_id=d120e3a1097648d59e4e023d26ddc00b, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:32.928031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:32.995426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 871/1740] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:32 2022] PUT /identity/v3/projects/cd6fb43bfd654ba69eed1a5478f4261f/users/d120e3a1097648d59e4e023d26ddc00b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:33.006966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:33.007571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:33.008028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:33.047800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:33.047800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:33.129826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] MFA Rules not processed for user `d120e3a1097648d59e4e023d26ddc00b`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:33.131666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:33.311954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80a71b-1c38-4e0e-96a6-3d6bdc3becc0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:33.350938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:33.351618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:33.351905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:33.352187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:33.371700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 870/1741] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:33.377373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:33.396897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:33.404374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406d9b-4908-4572-a242-c703f242eace service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:33.446607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 872/1742] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:33.614050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b22f4-c518-4d6d-b3da-125de08c4bb4 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:33.617784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b22f4-c518-4d6d-b3da-125de08c4bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:33.619102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b22f4-c518-4d6d-b3da-125de08c4bb4 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:33.620847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 873/1743] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:46:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:33.673568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:33.680308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b8dcd-063d-494b-8ffd-5396762bdc4b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:33.690679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:33.691382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:33.691672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:33.692632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:33.694656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:33.701775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:33.739424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:33.816465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:33.816848 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:33.817304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:33.848802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 871/1744] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:33 2022] POST /identity/v3/projects => generated 365 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:33.849734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:33.894353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:33.895638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:34.053572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b9c5d-468e-4390-b48b-d0f7e6d51aaa admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:34.071930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:34.071930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:34.071930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:34.071930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:34.072461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:34.074950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 874/1745] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:46:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:34.082890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:34.184468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 872/1746] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:33 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:34.189043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:34.207075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d811d6-dd8c-414f-aac3-3daaba4f9080 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:34.227642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:34.228533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:34.229247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:34.229679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:34.230691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:34.232579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d86b55-3e3e-4e45-b65e-1cc3fa66b3ad admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:34.266200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:34.272811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 875/1747] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:34.280588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7b22e-71ee-4833-a8bd-f24982fd38ac admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:34.291890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:34.292989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:34.294367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:34.294898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] PATH_INFO: `/v3/projects/49b1ebbce39240588460cbddba079dd4/users/721213c8ad444d4098f14174fbff3203/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:34.300085 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:34.356636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b1ebbce39240588460cbddba079dd4, user_id=721213c8ad444d4098f14174fbff3203, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:34.359612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:34.552743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:34.555885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:34.556375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:34.625328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] MFA Rules not processed for user `f0d12edb8e754ddb9578226105d4fa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:34.639113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:34.723821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 873/1748] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:34 2022] PUT /identity/v3/projects/49b1ebbce39240588460cbddba079dd4/users/721213c8ad444d4098f14174fbff3203/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:34.724208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:34.957831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420fc0b-7cea-4aac-979e-bffcf211b18e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:34.969483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:34.971376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:34.971887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:34.972385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:34.973369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:34.975677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:34.982401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 876/1749] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:34.985501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:34.992682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 874/1750] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:34.993913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:34.999806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:35.047127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebdb1c-0e2c-42ef-89d5-845eafe40883 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:35.060898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:35.064816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.065933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.076831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2f33-e893-450d-9065-c9e24734a91e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:35.087613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] PATH_INFO: `/v3/projects/49b1ebbce39240588460cbddba079dd4/users/721213c8ad444d4098f14174fbff3203/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.098024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b1ebbce39240588460cbddba079dd4, user_id=721213c8ad444d4098f14174fbff3203, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:35.113877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ace83-a836-408a-bc0d-79e5279d7b01 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:35.151154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 875/1751] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:34 2022] PUT /identity/v3/projects/49b1ebbce39240588460cbddba079dd4/users/721213c8ad444d4098f14174fbff3203/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:35.153184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:35.164474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.165392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.165952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.229383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:35.274833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] MFA Rules not processed for user `721213c8ad444d4098f14174fbff3203`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:35.276079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:35.288230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:35.288230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.288230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.288230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.323930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:35.327904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:35.345615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 877/1752] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:35.476426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 876/1753] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:35.488829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:35.491015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:35.650115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be731278-c369-4c07-9224-805c46176ca1 service nova] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:35.698507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:35.700541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:35.803876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:35.804527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.804803 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.805082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.826719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:35.830205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:35.853350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0df9d-c139-40c4-9c05-5872ef6a6be6 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:35.854295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 878/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:35.855740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:35.858982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:35.863681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:35.864433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.864731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.865151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] PATH_INFO: `/v3/projects/fb637bdffe694c6d99f37aaf4a4e0c38` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.867639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb637bdffe694c6d99f37aaf4a4e0c38)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:35.875635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:35.890676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd247-d692-4313-a12c-3ced7b05d456 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:35.908175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:35.909639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:35.910036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:35.910242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] PATH_INFO: `/v3/projects/2f1b700135134e25bd868d9732397af2` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:35.911798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1b700135134e25bd868d9732397af2)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:35.916490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:36.201014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:36.226784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb637bdffe694c6d99f37aaf4a4e0c38', 'request_id': 'req-24e75cfc-423e-4085-9ad2-bd07d2b42709'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.239211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb637bdffe694c6d99f37aaf4a4e0c38', 'request_id': 'req-24e75cfc-423e-4085-9ad2-bd07d2b42709'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.254358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1b700135134e25bd868d9732397af2', 'request_id': 'req-58f694ff-2652-4c9b-bc6e-c4950def4c4d'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.270982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1b700135134e25bd868d9732397af2', 'request_id': 'req-58f694ff-2652-4c9b-bc6e-c4950def4c4d'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.356938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb637bdffe694c6d99f37aaf4a4e0c38', 'request_id': 'req-24e75cfc-423e-4085-9ad2-bd07d2b42709'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.380289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] The token cache is being invalidate because project fb637bdffe694c6d99f37aaf4a4e0c38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:36.380289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.380289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.392570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 877/1755] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:35 2022] DELETE /identity/v3/projects/fb637bdffe694c6d99f37aaf4a4e0c38 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:36.396656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:36.403133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:36.551768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1b700135134e25bd868d9732397af2', 'request_id': 'req-58f694ff-2652-4c9b-bc6e-c4950def4c4d'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.573812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] The token cache is being invalidate because project 2f1b700135134e25bd868d9732397af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:36.574328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.575687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58f694ff-2652-4c9b-bc6e-c4950def4c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.587190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 879/1756] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:35 2022] DELETE /identity/v3/projects/2f1b700135134e25bd868d9732397af2 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:36.588722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c8c-2da0-450e-ae46-0b5ca86a999e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:36.589045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c8c-2da0-450e-ae46-0b5ca86a999e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:36.589275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c8c-2da0-450e-ae46-0b5ca86a999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:36.598209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75cfc-423e-4085-9ad2-bd07d2b42709 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:36.651807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-96d66c8c-2da0-450e-ae46-0b5ca86a999e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:36.660174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-96d66c8c-2da0-450e-ae46-0b5ca86a999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:36.706606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:36.727634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:36.728778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:36.729580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:36.730015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] PATH_INFO: `/v3/users/84f797c8dc444b54a41bd7b60c52faf2` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:36.731541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f797c8dc444b54a41bd7b60c52faf2)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:36.733710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:36.872017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 880/1757] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:36.879533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:36.883790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:36.883790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:36.910484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:36.912722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:36.930449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 881/1758] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:36.931964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:36.967364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d43c1-3489-4e36-835c-91516dd6e004 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:36.975317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f797c8dc444b54a41bd7b60c52faf2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:36.978572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:36.979339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:36.981605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:36.981605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:36.981605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:36.981605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:36.990684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:37.023070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f797c8dc444b54a41bd7b60c52faf2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:37.039522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f797c8dc444b54a41bd7b60c52faf2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:37.040530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f797c8dc444b54a41bd7b60c52faf2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:37.041533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f797c8dc444b54a41bd7b60c52faf2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:37.076565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 882/1759] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:37.078027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:37.082237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:37.101088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed2545-7687-4a1d-a629-095aa8de2a3f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:37.114779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:37.115559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:37.115919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:37.116269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:37.117397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:37.120047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:37.164351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 878/1760] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:36 2022] DELETE /identity/v3/users/84f797c8dc444b54a41bd7b60c52faf2 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:37.220560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 883/1761] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:37 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:37.229083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:37.315624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025daa-3224-4cf0-b669-14a3c1e196ec admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:37.434760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:37.436028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:37.437143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:37.437883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:37.450510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:37.452780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0b54bd-fec9-4288-9bcd-0ec625b48c2d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:37.773398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 879/1762] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:37 2022] POST /identity/v3/users => generated 289 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:37.775178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:37.810120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f58f51-a749-4a90-961c-438f7070c1be admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:37.822606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:37.823067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:37.823394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:37.836174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:37.836736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:37.837249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:37.837608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:37.848706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:37.856474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:37.908749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 884/1763] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:37.910539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:37.912641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] MFA Rules not processed for user `715bb36a29d743e1b8b0fbad427efcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:37.916016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:37.944468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e7c1-8540-4b41-8d51-913c1a617d69 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:37.944468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:37.944930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:37.945263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:37.945548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:37.946919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:37.949969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:37.966889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 885/1764] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:37.982530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:38.005154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca99b2-5ff3-4521-bd9d-f5de50f81447 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:38.024389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:38.025967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.026557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.027021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] PATH_INFO: `/v3/projects/36b1ce868bc644d29a8b19f301e13790/users/fd89952cb7fb4ca497a671e66029b7bb/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.062777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b1ce868bc644d29a8b19f301e13790, user_id=fd89952cb7fb4ca497a671e66029b7bb, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:38.067807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d6e0d-836a-40ec-875d-69f30e55e96f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:38.069114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 880/1765] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:38.070036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:38.075214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.094627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54bbc15-84f5-4df8-9522-54bdfe9e840c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:38.102714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:38.103968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.104459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.104879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] PATH_INFO: `/v3/users/d120e3a1097648d59e4e023d26ddc00b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.107204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d120e3a1097648d59e4e023d26ddc00b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:38.110489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:38.182300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 886/1766] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:37 2022] PUT /identity/v3/projects/36b1ce868bc644d29a8b19f301e13790/users/fd89952cb7fb4ca497a671e66029b7bb/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:38.193014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389419d-f570-4fe0-b502-2d87f6c8697e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.193307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389419d-f570-4fe0-b502-2d87f6c8697e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.193589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389419d-f570-4fe0-b502-2d87f6c8697e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.290891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1389419d-f570-4fe0-b502-2d87f6c8697e None None] MFA Rules not processed for user `fd89952cb7fb4ca497a671e66029b7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:38.291625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd120e3a1097648d59e4e023d26ddc00b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:38.294669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1389419d-f570-4fe0-b502-2d87f6c8697e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.325008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd120e3a1097648d59e4e023d26ddc00b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:38.342850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd120e3a1097648d59e4e023d26ddc00b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:38.343957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd120e3a1097648d59e4e023d26ddc00b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:38.344840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3b6c54b-67dc-4ca3-8c91-ffc64c9f05b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd120e3a1097648d59e4e023d26ddc00b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:38.416353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 881/1767] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:38 2022] DELETE /identity/v3/users/d120e3a1097648d59e4e023d26ddc00b => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:38.421367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.422143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.422589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.488887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:38.490427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.501019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:38.551165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 887/1768] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:38.552876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.555241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.555741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.602931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] MFA Rules not processed for user `0bd253c869e7428ca8765eeb8e8122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:38.604125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.691702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 882/1769] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:38.692682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:38.694041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.695569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 888/1770] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:38.719263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:38.720997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:38.840152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d02b3-7b10-45e5-ab90-c70c313b5f4e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:38.872061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:38.872690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.872974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.875943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.929010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acffcb-62c7-4981-af04-f3191d0ee5b2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:38.947805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:38.948756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:38.949046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:38.950105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:38.967042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:38.970582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:38.988648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 889/1771] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:38.995275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:38.997483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd97f38-497f-472b-99a8-01757e5bde6b service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:39.020027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 883/1772] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:39.282372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:39.741937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:39.743495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:39.767665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcd191-fbeb-46cd-8962-fb431ca17bf6 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:39.780751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:39.781728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:39.782071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:39.782337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] PATH_INFO: `/v3/projects/44291ee2ed2a4bf0bdedc852245c37da` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:39.784768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44291ee2ed2a4bf0bdedc852245c37da)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:39.786738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.047116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44291ee2ed2a4bf0bdedc852245c37da', 'request_id': 'req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.056491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44291ee2ed2a4bf0bdedc852245c37da', 'request_id': 'req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.146028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44291ee2ed2a4bf0bdedc852245c37da', 'request_id': 'req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.163240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] The token cache is being invalidate because project 44291ee2ed2a4bf0bdedc852245c37da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:40.163526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.164217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.165814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 890/1773] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:39 2022] DELETE /identity/v3/projects/44291ee2ed2a4bf0bdedc852245c37da => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:40.171046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bba8-5ad7-4924-b7f0-e42cb72ceb57 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.171571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bba8-5ad7-4924-b7f0-e42cb72ceb57 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.171571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478bba8-5ad7-4924-b7f0-e42cb72ceb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.191636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9478bba8-5ad7-4924-b7f0-e42cb72ceb57 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:40.192931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9478bba8-5ad7-4924-b7f0-e42cb72ceb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:40.242277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.242593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:40.260258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 884/1774] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:40.275891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f637bae-0509-4187-9a01-372982919caa None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.276156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f637bae-0509-4187-9a01-372982919caa None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.276575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f637bae-0509-4187-9a01-372982919caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.305941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5f637bae-0509-4187-9a01-372982919caa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:40.307571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5f637bae-0509-4187-9a01-372982919caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:40.322751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 885/1775] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:40.322939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f637bae-0509-4187-9a01-372982919caa None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.334020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f637bae-0509-4187-9a01-372982919caa None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.338508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.339136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.339424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.339727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.340455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:40.340762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.342501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.349048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799802e5-4bc5-4b26-ab00-eae8ba33d5a0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.354437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.355459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.355842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.356219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] PATH_INFO: `/v3/projects/cd6fb43bfd654ba69eed1a5478f4261f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.357331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 886/1776] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:40.357661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6fb43bfd654ba69eed1a5478f4261f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.359664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.362290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.379485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e79950-ad5f-4d1c-94f7-e5d3b2a77468 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.379485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.380273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.380631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.381012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.381780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.383874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.562032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 887/1777] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:40 2022] POST /identity/v3/projects => generated 369 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:40.565826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.577347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6fb43bfd654ba69eed1a5478f4261f', 'request_id': 'req-da2082e8-e735-4640-8cec-476bc43427ff'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.592291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6fb43bfd654ba69eed1a5478f4261f', 'request_id': 'req-da2082e8-e735-4640-8cec-476bc43427ff'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.661188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfeb3db-d4a0-4c0d-8cb0-19b94d215406 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.682396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.683099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.683386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.684455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.688978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.695326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.717096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6fb43bfd654ba69eed1a5478f4261f', 'request_id': 'req-da2082e8-e735-4640-8cec-476bc43427ff'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.736196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] The token cache is being invalidate because project cd6fb43bfd654ba69eed1a5478f4261f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:40.736484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.737197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:40.739152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 891/1778] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:40 2022] DELETE /identity/v3/projects/cd6fb43bfd654ba69eed1a5478f4261f => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:40.743039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.753239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:40.813870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 888/1779] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:40 2022] POST /identity/v3/users => generated 285 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:40.820310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.822268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:40.839307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f24c5-5aaf-4bff-8cc9-161196194d42 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.846911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.849800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.849800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.849800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.850130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.852133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.878986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 889/1780] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:40.881298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:40.906778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1143c9-dad4-463d-8496-0f0cf04432fa admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.923808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.924702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.925171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.925469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.929686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:40.955762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:40.966745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2082e8-e735-4640-8cec-476bc43427ff admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:40.991793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:40.994074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:40.994467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:40.994867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] PATH_INFO: `/v3/users/721213c8ad444d4098f14174fbff3203` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:40.996549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=721213c8ad444d4098f14174fbff3203)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.002164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.011048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 890/1781] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:41.017222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.060591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8563c9-c7fe-441c-947c-1cdc052f9692 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.068597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.069588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.083479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:41.097487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.097840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] PATH_INFO: `/v3/projects/9f270e8f36b149dbafbbd5a9286c6473/users/586238a30cec47679ac6fcc8c5e19176/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.126418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f270e8f36b149dbafbbd5a9286c6473, user_id=586238a30cec47679ac6fcc8c5e19176, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.129689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052a183-ea61-4757-85d0-c2bfcdf18067 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.255409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 891/1782] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:41 2022] PUT /identity/v3/projects/9f270e8f36b149dbafbbd5a9286c6473/users/586238a30cec47679ac6fcc8c5e19176/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:41.266425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.266719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.266998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.295342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '721213c8ad444d4098f14174fbff3203'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:41.304634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] MFA Rules not processed for user `586238a30cec47679ac6fcc8c5e19176`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:41.306239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:41.319799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '721213c8ad444d4098f14174fbff3203'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:41.373780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 892/1783] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:41.378100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.417620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:41.427917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '721213c8ad444d4098f14174fbff3203'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:41.429350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '721213c8ad444d4098f14174fbff3203'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:41.444988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '721213c8ad444d4098f14174fbff3203'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:41.447723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5b894-c465-4d17-a5d5-88d1725afe1d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.453017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.453683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.453995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.454283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.455037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.455889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 892/1784] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:40 2022] DELETE /identity/v3/users/721213c8ad444d4098f14174fbff3203 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:41.457179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.554617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 893/1785] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:41 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:41.556139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.558052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:41.638063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af005a9f-7ac0-4f84-a0a4-69415a474cbd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.702503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.703197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.703612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.703890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.707108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.708968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.868779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 893/1786] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:41 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:41.873183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.883321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcddfe2-a78b-4b1b-afd2-53813fa8614c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.888288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.888939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.889221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.889594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.890283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.892154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.903687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 894/1787] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:41.907623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.917834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1d87a-d41a-4ade-858d-bf3a7bacce23 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.922604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.923503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.923780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.924057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] PATH_INFO: `/v3/projects/104a217f0c9a4903a32946578b8c0ca7/users/82b241c1fa564e8a9424d31337b3953e/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.939663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=104a217f0c9a4903a32946578b8c0ca7, user_id=82b241c1fa564e8a9424d31337b3953e, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:41.942430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:41.964113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:41.965993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:41.981412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f37e5-c75a-4ac2-a61b-770983bbe280 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:41.992369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:41.993307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:41.997477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:41.997477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] PATH_INFO: `/v3/projects/49b1ebbce39240588460cbddba079dd4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:41.998946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b1ebbce39240588460cbddba079dd4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.000851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.019525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 894/1788] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:41 2022] PUT /identity/v3/projects/104a217f0c9a4903a32946578b8c0ca7/users/82b241c1fa564e8a9424d31337b3953e/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:42.020577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.084468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cbb3e5-87e2-4091-80c4-f5c7473259bb admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.089188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.089902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.090193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.090473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.091197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.092789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.103192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 895/1789] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:42.107734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.118975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195e6a0-ea10-4af8-b86a-5be4b963e1f0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.141045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b1ebbce39240588460cbddba079dd4', 'request_id': 'req-d24968b2-82e2-48d8-8800-069acd2720ad'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:42.147461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b1ebbce39240588460cbddba079dd4', 'request_id': 'req-d24968b2-82e2-48d8-8800-069acd2720ad'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:42.187889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.190076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.190076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.190076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] PATH_INFO: `/v3/projects/104a217f0c9a4903a32946578b8c0ca7/users/82b241c1fa564e8a9424d31337b3953e/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.191659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104a217f0c9a4903a32946578b8c0ca7, user_id=82b241c1fa564e8a9424d31337b3953e, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.194403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158c0954-c7a8-4753-a8aa-2648b1769963 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.205616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 896/1790] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:42 2022] PUT /identity/v3/projects/104a217f0c9a4903a32946578b8c0ca7/users/82b241c1fa564e8a9424d31337b3953e/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:42.223014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.223313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.223770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.232529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b1ebbce39240588460cbddba079dd4', 'request_id': 'req-d24968b2-82e2-48d8-8800-069acd2720ad'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:42.245078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] The token cache is being invalidate because project 49b1ebbce39240588460cbddba079dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:42.245489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:42.246963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d24968b2-82e2-48d8-8800-069acd2720ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:42.249882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 895/1791] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:41 2022] DELETE /identity/v3/projects/49b1ebbce39240588460cbddba079dd4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:42.254709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23e94-5bdc-4d8a-872c-9b7aed99795d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.255413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23e94-5bdc-4d8a-872c-9b7aed99795d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.255898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba23e94-5bdc-4d8a-872c-9b7aed99795d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.256474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] MFA Rules not processed for user `82b241c1fa564e8a9424d31337b3953e`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:42.257714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:42.276090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0ba23e94-5bdc-4d8a-872c-9b7aed99795d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:42.277528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0ba23e94-5bdc-4d8a-872c-9b7aed99795d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:42.332796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 897/1792] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:42.344829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.347678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:42.356561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 896/1793] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:42.367148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.367436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.367779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.388682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:42.390013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:42.398709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 897/1794] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:42.403145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.408619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37925303-bac2-4517-916e-d9185235b2e2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.411986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7d72-8877-4cd6-a09e-5349590480b0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.412176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.412811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.413092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.413386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.416656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.417300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.417598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.419571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.420306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:42.420618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.422268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.423376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.424801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.434323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 898/1795] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:46:42.434618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 898/1796] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:42.442520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.449216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607940d9-026c-4015-aff1-cdbf82f35bbb admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.454525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.455176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.455462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.455742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.456445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.458416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.564614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 899/1797] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:42.568257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.579252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3528-16a7-4777-aa75-1389af84129a service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.637584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.638443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.638739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.639019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.639724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.641870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.706080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 899/1798] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:42.710418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.721329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca9da0-30bf-46bb-a891-ec3e95d7ed77 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.726901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.727561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.729092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.729092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.729092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.731129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.750258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 900/1799] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:42.754220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.765426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca4a77-9971-408c-81ee-977082de8f46 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.770079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.770738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.771024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.771299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.772027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.773647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5245f0-6fd6-495e-aa31-3e94b3e3c522 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.784140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 900/1800] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:42.788456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:42.798281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da23bdc-192c-40fa-a2dc-a13aa4296686 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:42.803556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:42.804432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.804718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.804998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] PATH_INFO: `/v3/projects/3d0d80f7da444c62afb166eff268b19d/users/e307d19c008044cfb3f97ce6fdb5c47c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.819464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d0d80f7da444c62afb166eff268b19d, user_id=e307d19c008044cfb3f97ce6fdb5c47c, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:42.822272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:42.910896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 901/1801] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:42 2022] PUT /identity/v3/projects/3d0d80f7da444c62afb166eff268b19d/users/e307d19c008044cfb3f97ce6fdb5c47c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:42.921279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:42.921571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:42.921869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:42.953261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] MFA Rules not processed for user `e307d19c008044cfb3f97ce6fdb5c47c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:42.954674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:43.025408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 901/1802] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:43.030051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.093781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5b83f-fb82-4d0d-a4c1-a751a0c472fa admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.098638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.099291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.099573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.099853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.100534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.102459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.173433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:43.185124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 902/1803] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:43 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:43.189902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.203467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c9b7c-ba1d-45a3-83d8-86330438c6d0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.289749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.290515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.290812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.291090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.291789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.293930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.386386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 902/1804] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:43 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:43.390980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.401320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a79982-1154-4ebf-994f-41b278b7811c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.404023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:43.408011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.408751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.409015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.409319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.410090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.411690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.425520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 903/1805] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:43.426866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.437988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ea093-cfa8-4ac8-bd25-a6c0015e7d7f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.442941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.443935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.444284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.444651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] PATH_INFO: `/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28/users/79ed8618402c4a21acc21f4e95004cb0/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.463666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f615cb5b4e4ef5b57a0cfd25acab28, user_id=79ed8618402c4a21acc21f4e95004cb0, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.466301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.570876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 903/1806] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:43 2022] PUT /identity/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28/users/79ed8618402c4a21acc21f4e95004cb0/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:43.574813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.585210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87c19f-8d05-4fd2-afc1-00aecddbaa58 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.644067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.644318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.644601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.644898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.645627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.647265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbb893-40e0-46b7-a172-28ecdd3f0095 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.657127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 904/1807] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:43.661394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.672416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b9f7-657c-436b-9353-4fab34a2becc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.677181 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.678083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.678367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.678642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] PATH_INFO: `/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28/users/79ed8618402c4a21acc21f4e95004cb0/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.681050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f615cb5b4e4ef5b57a0cfd25acab28, user_id=79ed8618402c4a21acc21f4e95004cb0, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.685547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.694517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 904/1808] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:43 2022] PUT /identity/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28/users/79ed8618402c4a21acc21f4e95004cb0/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:43.708709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.708709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.708709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.735207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] MFA Rules not processed for user `79ed8618402c4a21acc21f4e95004cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:43.736377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:43.805195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 905/1809] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:43.816912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:43.872086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5bbe7-8c08-4dea-80bd-457cf0d8441e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:43.875770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:43.876699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:43.877255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:43.877805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:43.888755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:43.890274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237aad-bac0-4435-8482-b4c80d867be6 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:43.900853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 905/1810] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:46:43.978721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:44.055240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0814e663-7564-4589-bd63-009904fd4f60 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:44.060779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:44.061803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:44.062126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:44.062625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] PATH_INFO: `/v3/users/e307d19c008044cfb3f97ce6fdb5c47c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:44.064678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e307d19c008044cfb3f97ce6fdb5c47c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:44.068109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:44.276075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e307d19c008044cfb3f97ce6fdb5c47c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:44.288277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e307d19c008044cfb3f97ce6fdb5c47c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:44.295687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e307d19c008044cfb3f97ce6fdb5c47c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:44.296542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e307d19c008044cfb3f97ce6fdb5c47c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:44.297158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e307d19c008044cfb3f97ce6fdb5c47c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:44.397728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 906/1811] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:43 2022] DELETE /identity/v3/users/e307d19c008044cfb3f97ce6fdb5c47c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:44.402179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:44.402613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:44.402776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:44.422249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:44.423580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:44.493838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 906/1812] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:44.501367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:44.502866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:44.586528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ead2e-bc51-41c2-a776-1b863958a56f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:44.586945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:44.587476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:44.587585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:44.587828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:44.600774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:44.602622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:44.616537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 907/1813] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:45.061239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:45.068556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:45.069982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:45.093594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f1c6e-c5ca-4541-96c2-3f8294c42664 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:45.099922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:45.100793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:45.101224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:45.101516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] PATH_INFO: `/v3/projects/3d0d80f7da444c62afb166eff268b19d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:45.102739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d0d80f7da444c62afb166eff268b19d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:45.105941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:45.233138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d0d80f7da444c62afb166eff268b19d', 'request_id': 'req-2d0ce4c9-e7ea-4872-9336-4135325aaada'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.237057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:45.240641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d0d80f7da444c62afb166eff268b19d', 'request_id': 'req-2d0ce4c9-e7ea-4872-9336-4135325aaada'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.310796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d0d80f7da444c62afb166eff268b19d', 'request_id': 'req-2d0ce4c9-e7ea-4872-9336-4135325aaada'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.321977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] The token cache is being invalidate because project 3d0d80f7da444c62afb166eff268b19d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:45.322258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.322879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.324470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 907/1814] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:45 2022] DELETE /identity/v3/projects/3d0d80f7da444c62afb166eff268b19d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:45.328612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:45.338499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf7294-f7cc-454b-ab39-24ece777b0ba service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:45.385041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:45.386474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:45.395980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:45.396855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:45.397145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:45.398663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] PATH_INFO: `/v3/users/79ed8618402c4a21acc21f4e95004cb0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:45.398663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ed8618402c4a21acc21f4e95004cb0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:45.400542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:45.456006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce4c9-e7ea-4872-9336-4135325aaada admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:45.457208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:45.458177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:45.458533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:45.458876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] PATH_INFO: `/v3/users/586238a30cec47679ac6fcc8c5e19176` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:45.460141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=586238a30cec47679ac6fcc8c5e19176)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:45.462074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:45.638996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ed8618402c4a21acc21f4e95004cb0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.650689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ed8618402c4a21acc21f4e95004cb0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.659623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ed8618402c4a21acc21f4e95004cb0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.660565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ed8618402c4a21acc21f4e95004cb0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.664849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-4bdcacb3-a8d2-4533-87ef-4ddb26431804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ed8618402c4a21acc21f4e95004cb0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.670814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586238a30cec47679ac6fcc8c5e19176'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.682753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586238a30cec47679ac6fcc8c5e19176'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.774795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 908/1815] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:45 2022] DELETE /identity/v3/users/79ed8618402c4a21acc21f4e95004cb0 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:45.876770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586238a30cec47679ac6fcc8c5e19176'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.877402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586238a30cec47679ac6fcc8c5e19176'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.885084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586238a30cec47679ac6fcc8c5e19176'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:45.891831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 908/1816] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:45 2022] DELETE /identity/v3/users/586238a30cec47679ac6fcc8c5e19176 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:45.896288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:45.896580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:45.896860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:45.915029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:45.916226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:45.976625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 909/1817] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:45.986420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:45.987835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:46.049710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa8a901-f0a0-4e3a-88e7-35c2e83c04aa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:46.054382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:46.054382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.054382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.054660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.063781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:46.065165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a3167-3fec-4c68-b8e0-904ab1ad2644 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:46.075981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 909/1818] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:46.300218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:46.357332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:46.358978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:46.371733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb03a05-a53a-46b2-9a75-cce78bd50210 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:46.380966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:46.386411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.386411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.386411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] PATH_INFO: `/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.386411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f615cb5b4e4ef5b57a0cfd25acab28)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:46.386995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:46.448886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:46.494219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f615cb5b4e4ef5b57a0cfd25acab28', 'request_id': 'req-3a848014-99d3-470c-bad3-60a1509cef65'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.500119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f615cb5b4e4ef5b57a0cfd25acab28', 'request_id': 'req-3a848014-99d3-470c-bad3-60a1509cef65'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.618228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f615cb5b4e4ef5b57a0cfd25acab28', 'request_id': 'req-3a848014-99d3-470c-bad3-60a1509cef65'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.631446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] The token cache is being invalidate because project 76f615cb5b4e4ef5b57a0cfd25acab28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:46.631737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.632380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.634225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 910/1819] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:46 2022] DELETE /identity/v3/projects/76f615cb5b4e4ef5b57a0cfd25acab28 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:46.639222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5936-ea1c-462d-8df0-4f6b476f43a9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.639786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5936-ea1c-462d-8df0-4f6b476f43a9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.639917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d5936-ea1c-462d-8df0-4f6b476f43a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.658294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-352d5936-ea1c-462d-8df0-4f6b476f43a9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:46.659590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-352d5936-ea1c-462d-8df0-4f6b476f43a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:46.678744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:46.680387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:46.723485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 910/1820] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:46.731865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.732151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.732429 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.752160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:46.753667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:46.757588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a848014-99d3-470c-bad3-60a1509cef65 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:46.763157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:46.763993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 911/1821] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:46.764102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.764300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.764579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] PATH_INFO: `/v3/projects/9f270e8f36b149dbafbbd5a9286c6473` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.765785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f270e8f36b149dbafbbd5a9286c6473)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:46.767810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:46.768458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:46.778834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28cc4a1-cc97-4939-8b74-98c65099a1b1 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:46.783658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:46.784330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.784613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.785062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.785802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:46.786145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:46.787802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:46.801053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 912/1822] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:46.805421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:46.816142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815a7c3-d649-49b5-baa0-9bc4dc78caa3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:46.822105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:46.822769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:46.823052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:46.823334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:46.824189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:46.826540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:46.923481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f270e8f36b149dbafbbd5a9286c6473', 'request_id': 'req-e0ec35a6-4dfc-47e7-aef3-fc7070311947'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.929029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f270e8f36b149dbafbbd5a9286c6473', 'request_id': 'req-e0ec35a6-4dfc-47e7-aef3-fc7070311947'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:46.942174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 913/1823] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:46 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:46.946175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.011357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8159ea-e9fc-4ca7-bae0-72648a0a01bc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.016498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.017170 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.017454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.017786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.018568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.020521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.036237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f270e8f36b149dbafbbd5a9286c6473', 'request_id': 'req-e0ec35a6-4dfc-47e7-aef3-fc7070311947'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.052198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] The token cache is being invalidate because project 9f270e8f36b149dbafbbd5a9286c6473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:47.052402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.053295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.054975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 911/1824] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:46 2022] DELETE /identity/v3/projects/9f270e8f36b149dbafbbd5a9286c6473 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:47.059647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.063118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:47.106819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 914/1825] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:46 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:47.110614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.112326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:47.125742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484f448-56f0-49fe-bec0-8164e29f180d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.131235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.140861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.140861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.140861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.141134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec35a6-4dfc-47e7-aef3-fc7070311947 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.141237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.141237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.141359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.141359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.141359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.141359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] PATH_INFO: `/v3/users/82b241c1fa564e8a9424d31337b3953e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.141607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b241c1fa564e8a9424d31337b3953e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.142602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.146169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 915/1826] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:47.150106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.160855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d125ec2-b910-401f-ba87-9b9e1f8a82bd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.165841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.166530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.166815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.167092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.167885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.169485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.180806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 916/1827] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:47.189393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.199934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce983348-c990-45c0-9df3-a06107c42124 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.204703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.205637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.205912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.206190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] PATH_INFO: `/v3/projects/c5257c022eed41a4b77cca9617a6c0a2/users/b855b786d4c6450292b8edaa46b5dbb1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.221303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5257c022eed41a4b77cca9617a6c0a2, user_id=b855b786d4c6450292b8edaa46b5dbb1, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.224238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292904c5-5888-4d14-a585-19a19716b58b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.269895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:47.304947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 917/1828] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:47 2022] PUT /identity/v3/projects/c5257c022eed41a4b77cca9617a6c0a2/users/b855b786d4c6450292b8edaa46b5dbb1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:47.315918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.316213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.316557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.343492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b241c1fa564e8a9424d31337b3953e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.343854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] MFA Rules not processed for user `b855b786d4c6450292b8edaa46b5dbb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:47.345068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:47.358935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b241c1fa564e8a9424d31337b3953e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.367649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b241c1fa564e8a9424d31337b3953e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.368520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b241c1fa564e8a9424d31337b3953e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.369267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b241c1fa564e8a9424d31337b3953e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:47.413576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 918/1829] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:47.418616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.420010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:47.476300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 912/1830] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:46:47 2022] DELETE /identity/v3/users/82b241c1fa564e8a9424d31337b3953e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:47.505312 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484a232-4ec9-4bcb-ace0-3aa491c1f803 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.562291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.562879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.563160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.563452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.564124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.566066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.720008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 919/1831] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:47 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:47.721725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:47.748125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f841046-8cf2-4612-b2d9-a91bf5d4cbfc admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:47.802921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:47.892113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:47.893055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:47.893484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:47.893895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:47.894690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:47.897344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:47.988756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 913/1832] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:47 2022] POST /identity/v3/users => generated 293 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:47.996467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.007924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad293606-a8da-4e13-bb57-5007dd24e1ba admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.009285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.024647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:48.034649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.035350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.035669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.036608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.036911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.039621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.047053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0afd2f-f727-4800-afc9-67fba286b55a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.060183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.063737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.064981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.065491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] PATH_INFO: `/v3/projects/104a217f0c9a4903a32946578b8c0ca7` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.067967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=104a217f0c9a4903a32946578b8c0ca7)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.069660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 920/1833] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:48.070618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.073562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.086396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd25d-d70c-4105-a7c5-010549f4b7dc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.092465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.093146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.093687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.095286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.095286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.097063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.113924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:48.113924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 921/1834] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:46:48.113924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.125548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e4907-7190-4e8c-8b58-95b7ac99fb72 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.130442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.131339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.131619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.131895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] PATH_INFO: `/v3/projects/dac40e450e5543548c0864b37a297934/users/c62ee77d18824cff831460e2d83cb831/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.165232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac40e450e5543548c0864b37a297934, user_id=c62ee77d18824cff831460e2d83cb831, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.169157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b05bc3-d51d-4fa6-9574-831d87ae694f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.285400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 922/1835] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:48 2022] PUT /identity/v3/projects/dac40e450e5543548c0864b37a297934/users/c62ee77d18824cff831460e2d83cb831/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:48.311592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104a217f0c9a4903a32946578b8c0ca7', 'request_id': 'req-c4cbef12-6495-452e-aaab-8522578465d2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:48.313579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.314511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.314996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.321097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104a217f0c9a4903a32946578b8c0ca7', 'request_id': 'req-c4cbef12-6495-452e-aaab-8522578465d2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:48.349064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] MFA Rules not processed for user `c62ee77d18824cff831460e2d83cb831`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:48.350403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:48.420662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 923/1836] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:48.425235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.426534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104a217f0c9a4903a32946578b8c0ca7', 'request_id': 'req-c4cbef12-6495-452e-aaab-8522578465d2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:48.448136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] The token cache is being invalidate because project 104a217f0c9a4903a32946578b8c0ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:46:48.449618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:48.450529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4cbef12-6495-452e-aaab-8522578465d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:46:48.466867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 914/1837] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:46:48 2022] DELETE /identity/v3/projects/104a217f0c9a4903a32946578b8c0ca7 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:48.468802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b95ab-b0f3-49fd-ae0b-fd088c67cfc2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.469198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b95ab-b0f3-49fd-ae0b-fd088c67cfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.469727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b95ab-b0f3-49fd-ae0b-fd088c67cfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.492969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bc6b95ab-b0f3-49fd-ae0b-fd088c67cfc2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:48.501203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bc6b95ab-b0f3-49fd-ae0b-fd088c67cfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:48.502163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2763118-0fad-4f03-8efa-772c4f2bdc12 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.519301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.520052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.520795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.520795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.521633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.522062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 915/1838] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:48.523818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.530352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.530943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.531573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.552320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:48.554042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:48.569557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 916/1839] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:48.570625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.604407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10fdf1-0c4b-4a0d-8dae-1fca4dc2f9ca None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.616676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.617359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.617634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.618124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.618877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:46:48.619184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.621331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.659770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 917/1840] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:46:48.668692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.680009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10510b-fdec-4a4a-80a1-83d2310fc92e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.685539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.686272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.686783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.687075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.687829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.689771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fd3cc-77f7-4966-b477-4551361e0dd0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.724109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 924/1841] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/projects => generated 385 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:46:48.729306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.731964 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:48.812103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649cf67-8613-4605-a47b-46d05f068f0f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.817102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.818257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.818484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.818764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.819464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.821474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ccd76-50d2-4dab-bdd3-8452398e30db admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.866820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 918/1842] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/projects => generated 377 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:48.868278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d43-7a27-49aa-b93b-7d9c9075bb9e None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.868563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d43-7a27-49aa-b93b-7d9c9075bb9e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.868839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d1d43-7a27-49aa-b93b-7d9c9075bb9e None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.872449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 919/1843] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:46:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:46:48.873144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1d43-7a27-49aa-b93b-7d9c9075bb9e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:48.941341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d1d43-7a27-49aa-b93b-7d9c9075bb9e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:48.946293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:48.946973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.947257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.947534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.948229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:48.950292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:48.966088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 925/1844] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/users => generated 299 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:48.966088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721800-f10d-4c00-b471-46be68311e3f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:48.966088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721800-f10d-4c00-b471-46be68311e3f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:48.966088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721800-f10d-4c00-b471-46be68311e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:48.984811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-67721800-f10d-4c00-b471-46be68311e3f None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:48.986158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-67721800-f10d-4c00-b471-46be68311e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:49.059717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 926/1845] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:49.060451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721800-f10d-4c00-b471-46be68311e3f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.071173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721800-f10d-4c00-b471-46be68311e3f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.076300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.076978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.077315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.077601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.078579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.080190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.090510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 927/1846] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:49.094403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.096304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:49.103077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 920/1847] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:48 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:49.103077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.112871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0c557-aee2-425e-a84d-3a46c8c992cb admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.115032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009e756-28da-442b-abfc-c3882c8a79bf admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.119949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.120113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.121244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.121549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.121662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.121831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.121976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.122128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] PATH_INFO: `/v3/projects/db1d1651b24947778f1b24f33ad110ad/users/3a72f6992e51471f8f32d35bd47ad0a3/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.128160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:49.132993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.134918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.142965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1d1651b24947778f1b24f33ad110ad, user_id=3a72f6992e51471f8f32d35bd47ad0a3, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.145696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.147341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 928/1848] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:49.150815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.162433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1233b-4e8a-4b7f-852e-9e69f84a1b47 service nova] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.169829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.170664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.171056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.171438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.172503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.174568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.187615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 929/1849] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:49.191609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.205527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc53225-2edf-42c4-8d9c-3f4a2eb1ba28 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.210472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.211146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.211483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.211762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.212486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.214648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.231879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 930/1850] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:49.235968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.250154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424fccc-4a09-4422-845c-3c0534dccb05 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.255399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.256330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.256615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.257037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] PATH_INFO: `/v3/projects/1bce53dd9a0f4bf796a5ea1da297a649/users/b3faad848e0a48768cfd057565b67a3d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.275839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce53dd9a0f4bf796a5ea1da297a649, user_id=b3faad848e0a48768cfd057565b67a3d, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.279340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bd5b3-78c4-4216-8e09-94f5067e7485 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.303650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 921/1851] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:49 2022] PUT /identity/v3/projects/db1d1651b24947778f1b24f33ad110ad/users/3a72f6992e51471f8f32d35bd47ad0a3/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:49.304531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.383679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 931/1852] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:49 2022] PUT /identity/v3/projects/1bce53dd9a0f4bf796a5ea1da297a649/users/b3faad848e0a48768cfd057565b67a3d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:49.423202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.423202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.423202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.424211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98476d-e102-437d-b941-ac8dddfe3296 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.458482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] MFA Rules not processed for user `b3faad848e0a48768cfd057565b67a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:49.462141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:49.497330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.498104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.498471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.498839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.499790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.501513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.520288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 922/1853] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:49.520288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.534926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c544c20-fc1c-432c-8c4a-04651b7a055b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.543782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.547002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.547556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.548141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] PATH_INFO: `/v3/projects/db1d1651b24947778f1b24f33ad110ad/users/3a72f6992e51471f8f32d35bd47ad0a3/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.551865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1d1651b24947778f1b24f33ad110ad, user_id=3a72f6992e51471f8f32d35bd47ad0a3, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.555152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e312af8-f895-43bd-b103-aadcd1ddd910 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.578095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 923/1854] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:49 2022] PUT /identity/v3/projects/db1d1651b24947778f1b24f33ad110ad/users/3a72f6992e51471f8f32d35bd47ad0a3/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:46:49.580899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.581190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.581676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.596344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 932/1855] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:46:49.600450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.617736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4628b3-2d2f-4a58-b452-4533418ca736 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:49.675938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] MFA Rules not processed for user `3a72f6992e51471f8f32d35bd47ad0a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:49.677213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:49.747120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:49.749028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:49.749379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:49.754671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:49.754671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:49.754984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:49.836153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 924/1856] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:49.848734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.854843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:49.911037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 933/1857] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:46:49 2022] POST /identity/v3/projects => generated 375 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:49.915628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:49.984881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141d886-a2e1-4ab4-a9f0-c7b6588f3b15 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.078263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a991918-0268-468f-a104-eddb46a5818d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.082752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.084882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.085314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.085723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.087834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.088616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.088904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.089727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.097910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.101092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.166621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.169102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.183075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 925/1858] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:50.241173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 934/1859] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:46:49 2022] POST /identity/v3/users => generated 294 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:46:50.245196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:50.263802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26500b96-f942-49ba-84f8-1cc4710a30a6 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.304028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.306134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.307310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.321067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.329139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.338740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.383417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 926/1860] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:50.384451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:50.399750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a6b52-8c68-4712-bc5d-363ec115c472 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.411052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.412567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.421456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.442967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] PATH_INFO: `/v3/projects/5d9cba38e07c48609b3322db6b3f51de/users/453817fc04c246a884e517117f8e4dee/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.486947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9cba38e07c48609b3322db6b3f51de, user_id=453817fc04c246a884e517117f8e4dee, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.490037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.516093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:50.694978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 935/1861] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:50 2022] PUT /identity/v3/projects/5d9cba38e07c48609b3322db6b3f51de/users/453817fc04c246a884e517117f8e4dee/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:50.699358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:50.711326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c054200-0ddb-4807-bd86-e1292d2d3aa8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.788379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.789149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.789992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.789992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.790472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.792281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad7ddd-f46a-4301-8f14-21b6a414cc2d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.810199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:50.810883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 927/1862] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:46:50.823385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e646ee-7ace-4880-9899-46c261e22cb5 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:50.835667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:50.836656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.838124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.838602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] PATH_INFO: `/v3/projects/5d9cba38e07c48609b3322db6b3f51de/users/453817fc04c246a884e517117f8e4dee/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.848722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d9cba38e07c48609b3322db6b3f51de, user_id=453817fc04c246a884e517117f8e4dee, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:50.851561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:50.875138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 936/1863] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:46:50 2022] PUT /identity/v3/projects/5d9cba38e07c48609b3322db6b3f51de/users/453817fc04c246a884e517117f8e4dee/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:46:50.896604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:50.896894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:50.897181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:50.937024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] MFA Rules not processed for user `453817fc04c246a884e517117f8e4dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:46:50.938381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:51.226800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 928/1864] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:46:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:46:51.227569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:51.471567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f21956-f9cc-448f-bd7f-fa9258343fbd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:51.471567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:51.471567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:51.471567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:51.472224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:51.472224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:51.472224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:51.472224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 937/1865] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:51.946975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:52.625409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:52.638938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ea6d5-589e-4e51-8aab-f83b1ae5c387 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:52.653199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:52.654580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:52.655062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:52.655491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:52.657773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:52.729102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:52.730492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:52.742493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 929/1866] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:56.267179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:56.268606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:56.280643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf36df-c2e5-47b3-aff8-1c2ad893b7e2 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:56.284271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:56.284991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:56.285346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:56.285694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:56.294913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:56.296410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:56.306790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 938/1867] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:56 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:56.431120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:57.859723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:46:58.696321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:46:58.705805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f168b5-f7e6-4639-aa4c-51d4e76ca0b7 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:46:58.709633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:46:58.710329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:46:58.710765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:46:58.711227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:46:58.713368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:46:58.779160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:46:58.780638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639e9a63-1e85-4d6b-a615-cbb0d0adc363 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:46:58.789677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 930/1868] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:46:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:46:59.928081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:00.060989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:00.062572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:00.143222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95166f79-161f-4ff7-82ab-47778052b029 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:00.149110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:00.150205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:00.150486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:00.158238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] PATH_INFO: `/v3/users/fd89952cb7fb4ca497a671e66029b7bb` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:00.158238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd89952cb7fb4ca497a671e66029b7bb)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:00.158238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:00.381691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd89952cb7fb4ca497a671e66029b7bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:00.395347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd89952cb7fb4ca497a671e66029b7bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:00.544744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd89952cb7fb4ca497a671e66029b7bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:00.545294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd89952cb7fb4ca497a671e66029b7bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:00.553691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd89952cb7fb4ca497a671e66029b7bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:00.561906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 939/1869] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:00 2022] DELETE /identity/v3/users/fd89952cb7fb4ca497a671e66029b7bb => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:00.567750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:00.567750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:00.567750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:00.585988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:00.587195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:00.646600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 931/1870] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:00.657304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:00.658773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:00.724509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c0d358-a807-4f52-a873-93c9bc3a3ef7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:00.728209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:00.728856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:00.729165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:00.729443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:00.739121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:00.740551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8bb3f4-e5b2-483c-88db-739d08135e5c service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:00.750810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 940/1871] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:01.803166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:01.805115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:01.833615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ad1c6-daf3-4d5c-8bdf-6a080ebf30b6 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:01.833615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:01.833615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:01.833615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:01.834310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] PATH_INFO: `/v3/projects/36b1ce868bc644d29a8b19f301e13790` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:01.834310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b1ce868bc644d29a8b19f301e13790)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:01.836011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:01.996875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b1ce868bc644d29a8b19f301e13790', 'request_id': 'req-bc324c45-e060-4cb3-af28-4a4483559738'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:02.002866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b1ce868bc644d29a8b19f301e13790', 'request_id': 'req-bc324c45-e060-4cb3-af28-4a4483559738'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:02.076049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b1ce868bc644d29a8b19f301e13790', 'request_id': 'req-bc324c45-e060-4cb3-af28-4a4483559738'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:02.088258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] The token cache is being invalidate because project 36b1ce868bc644d29a8b19f301e13790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:02.090757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:02.090757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-bc324c45-e060-4cb3-af28-4a4483559738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:02.091366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 932/1872] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:01 2022] DELETE /identity/v3/projects/36b1ce868bc644d29a8b19f301e13790 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:02.096406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.096892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.096985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.117122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:02.119395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:02.179236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 941/1873] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:02.187175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.187463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.187912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.207040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:02.211330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:02.216971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 933/1874] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:02.221575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.231838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe34ba0e-8415-43ef-b9d6-4bdda8be9ec9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.236579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.237229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.239881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.239881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.239881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:02.239881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.240508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.252135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 942/1875] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:02.256148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.263731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:02.267423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725fc5c-7b1d-438c-b803-7fa5bd664f67 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.288769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.289440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.289899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.290324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.291039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.293017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.434209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 934/1876] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:02 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:02.438271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.449499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027212d5-6466-4a5a-bdb7-5794e20ccd28 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.526849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.526849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.527258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.527544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.528262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.530216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.614283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 943/1877] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:02 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:02.618506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.629068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb264bf5-6d78-4e35-8095-f524929f6c1e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.634495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.635172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.635975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.636256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.637025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.638675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.651979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 935/1878] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:02.655786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.668259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb184b3a-0748-4436-992b-047128426d96 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.675356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.676291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.676717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.680428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.680428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.680428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b52f41-ac2a-4cbe-988d-8dbc6d1b1615 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.698517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 944/1879] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:02.698764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:02.710818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:02.712539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396b2c0-3019-4a29-8f07-402bfb1d35fd admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:02.725784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:02.730460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.730460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.730460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] PATH_INFO: `/v3/projects/b5aab27e83e04db99651063efacf606c/users/6fb67541e3084930a160ea61318acee3/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.757364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5aab27e83e04db99651063efacf606c, user_id=6fb67541e3084930a160ea61318acee3, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:02.761835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:02.867568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:02.867869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:02.868104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:02.875333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 936/1880] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:02 2022] PUT /identity/v3/projects/b5aab27e83e04db99651063efacf606c/users/6fb67541e3084930a160ea61318acee3/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:02.928478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] MFA Rules not processed for user `6fb67541e3084930a160ea61318acee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:02.930088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:03.013959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 945/1881] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:03.018625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.084713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e5cf9-6674-431e-ba12-5aaf1a69e545 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.090282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.090939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.091222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.091497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.092326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.094391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.182589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 937/1882] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:03 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:03.188780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.200804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40948c-cc9c-4317-a271-9b9ea242b2e7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.261739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.262449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.262735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.263013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.263725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.265640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.413986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 946/1883] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:03 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:03.418870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.429064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af2209-c37e-46bc-917f-80096a848556 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.433636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.434322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.434771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.434962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.435684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.437277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.448126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 938/1884] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:03.452084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.462230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59724d-2284-4de4-9dd5-7582f605e28d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.467377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.468033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.468321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.468624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.469353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.470983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.481470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 947/1885] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:03.485454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.495340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca100734-2cdc-4af7-8097-5953b10d6101 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.500229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.501103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.501385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.501661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] PATH_INFO: `/v3/projects/43cb8c2276ec400ea1a1df1d9ddff1e9/users/47a228d9e3924b9c985af7fd60d57812/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.518602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43cb8c2276ec400ea1a1df1d9ddff1e9, user_id=47a228d9e3924b9c985af7fd60d57812, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.521238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5811-f5fe-47ca-8bb6-dc600c170139 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.630476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.632589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:03.645933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e951-f992-4434-b00a-8e31e736d102 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.654122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.655093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.655440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.655817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] PATH_INFO: `/v3/users/b855b786d4c6450292b8edaa46b5dbb1` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.657421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b855b786d4c6450292b8edaa46b5dbb1)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.668541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.669178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 939/1886] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:03 2022] PUT /identity/v3/projects/43cb8c2276ec400ea1a1df1d9ddff1e9/users/47a228d9e3924b9c985af7fd60d57812/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:03.681455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.681929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.682360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.712238 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] MFA Rules not processed for user `47a228d9e3924b9c985af7fd60d57812`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:03.714060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:03.779856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 940/1887] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:03.784232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:03.846167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a57890-9bb1-4812-b07f-064abba7b13f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:03.850794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:03.851463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:03.851744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:03.852021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:03.852715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:03.855202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:03.909555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b855b786d4c6450292b8edaa46b5dbb1'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:03.951152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b855b786d4c6450292b8edaa46b5dbb1'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:03.964288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 941/1888] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:03 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:03.968202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.053196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b855b786d4c6450292b8edaa46b5dbb1'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:04.054347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b855b786d4c6450292b8edaa46b5dbb1'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:04.080823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c93414a2-4678-4f54-b162-377a69ddcff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b855b786d4c6450292b8edaa46b5dbb1'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:04.098228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ae370-8f49-48a5-a6ff-292aea0a613f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.103608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.104724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 948/1889] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:03 2022] DELETE /identity/v3/users/b855b786d4c6450292b8edaa46b5dbb1 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:04.108029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.108359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.108651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.109643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.110571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.111100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.111477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.111960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.136169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:04.137691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:04.219618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 949/1890] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:04.241496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 942/1891] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:03 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:04.243807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.246866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:04.271687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.274657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:04.275544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485a9ce-b862-4ece-8c03-fc8789491442 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.281386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.282103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.282393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.282739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.283628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.285507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.299932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 950/1892] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:04.304896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.332710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a057b5a-298f-4951-ac87-b3916c04b465 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.352802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.356932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.357228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.357513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] PATH_INFO: `/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47/users/4f9a3cf1ea7240ce9fa141182a55a563/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.388830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd014c5e-bdaf-4819-8854-3ecc86d974aa admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.410738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ce0c5b70264b1bb2651bd0dbb8bb47, user_id=4f9a3cf1ea7240ce9fa141182a55a563, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.413394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.430922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:04.457303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.458144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.458610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.458920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.493974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.498385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.506293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 951/1893] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:04 2022] PUT /identity/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47/users/4f9a3cf1ea7240ce9fa141182a55a563/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:04.510666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.524792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 943/1894] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:04.618444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282b3b2-902e-4bb8-9394-859c848fc6e3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.624443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.625292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.625887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.625887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.626736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.630263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcf8a0-43bb-46a1-8384-12c99028f784 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.648730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 952/1895] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:04.649927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.664388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaddd4d5-d032-4f16-a858-99af4fa8c325 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.669917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.674988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.674988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.674988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] PATH_INFO: `/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47/users/4f9a3cf1ea7240ce9fa141182a55a563/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.674988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ce0c5b70264b1bb2651bd0dbb8bb47, user_id=4f9a3cf1ea7240ce9fa141182a55a563, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:04.676303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:04.697558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 944/1896] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:04 2022] PUT /identity/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47/users/4f9a3cf1ea7240ce9fa141182a55a563/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:04.699745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.701951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.701951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.731211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] MFA Rules not processed for user `4f9a3cf1ea7240ce9fa141182a55a563`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:04.732804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:04.808789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 953/1897] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:04.820358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:04.822129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:04.917061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d9cc0-431e-4533-80aa-9b3c8f6ea96c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:04.922136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:04.924330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:04.924828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:04.925316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:04.928707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:05.012020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:05.057788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:05.058986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:05.069122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 945/1898] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:05.270630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:05.272117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:05.354817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ccc36-cece-47ea-8e95-db61abbd1ca8 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:05.359797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:05.360789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:05.361076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:05.361346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] PATH_INFO: `/v3/projects/c5257c022eed41a4b77cca9617a6c0a2` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:05.362602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5257c022eed41a4b77cca9617a6c0a2)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:05.364632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:05.467273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5257c022eed41a4b77cca9617a6c0a2', 'request_id': 'req-80f6c4ac-bd50-479e-9026-de82b11e1184'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.474316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5257c022eed41a4b77cca9617a6c0a2', 'request_id': 'req-80f6c4ac-bd50-479e-9026-de82b11e1184'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.554924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5257c022eed41a4b77cca9617a6c0a2', 'request_id': 'req-80f6c4ac-bd50-479e-9026-de82b11e1184'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.566594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] The token cache is being invalidate because project c5257c022eed41a4b77cca9617a6c0a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:05.566876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.567509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.569191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 954/1899] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:05 2022] DELETE /identity/v3/projects/c5257c022eed41a4b77cca9617a6c0a2 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:05.573629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:05.584318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456181ba-a679-4bcd-ac21-dca68c90f479 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:05.640139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:05.641009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:05.641290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:05.641563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] PATH_INFO: `/v3/users/c62ee77d18824cff831460e2d83cb831` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:05.642876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62ee77d18824cff831460e2d83cb831)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:05.644866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:05.855172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62ee77d18824cff831460e2d83cb831'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.867019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62ee77d18824cff831460e2d83cb831'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.874377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62ee77d18824cff831460e2d83cb831'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.875075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62ee77d18824cff831460e2d83cb831'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.875674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62ee77d18824cff831460e2d83cb831'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:05.940070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:05.948221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 946/1900] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:05 2022] DELETE /identity/v3/users/c62ee77d18824cff831460e2d83cb831 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:06.425240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:06.426991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:06.441249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6c4ac-bd50-479e-9026-de82b11e1184 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:06.509041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:06.510032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:06.510318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:06.510641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] PATH_INFO: `/v3/projects/dac40e450e5543548c0864b37a297934` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:06.512152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac40e450e5543548c0864b37a297934)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:06.514534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:06.615684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac40e450e5543548c0864b37a297934', 'request_id': 'req-ba398349-142d-4d62-8aa7-8cb432d58468'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:06.624946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac40e450e5543548c0864b37a297934', 'request_id': 'req-ba398349-142d-4d62-8aa7-8cb432d58468'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:06.710494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac40e450e5543548c0864b37a297934', 'request_id': 'req-ba398349-142d-4d62-8aa7-8cb432d58468'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:06.730599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] The token cache is being invalidate because project dac40e450e5543548c0864b37a297934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:06.730892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:06.731576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:06.733537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 955/1901] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:06 2022] DELETE /identity/v3/projects/dac40e450e5543548c0864b37a297934 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:06.737240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:06.738686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:06.751427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639436f-a3fc-408f-a8c4-06c25139ed6a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:06.812820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:06.813700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:06.814173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:06.814447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] PATH_INFO: `/v3/users/3a72f6992e51471f8f32d35bd47ad0a3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:06.815634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a72f6992e51471f8f32d35bd47ad0a3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:06.817826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:06.991353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a72f6992e51471f8f32d35bd47ad0a3'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.006349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a72f6992e51471f8f32d35bd47ad0a3'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.016058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a72f6992e51471f8f32d35bd47ad0a3'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.016793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a72f6992e51471f8f32d35bd47ad0a3'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.017912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a72f6992e51471f8f32d35bd47ad0a3'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.019147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:07.020697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:07.058977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:07.078903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba398349-142d-4d62-8aa7-8cb432d58468 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:07.082541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:07.083193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:07.083474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:07.083750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:07.085560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:07.104732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 947/1902] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:06 2022] DELETE /identity/v3/users/3a72f6992e51471f8f32d35bd47ad0a3 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:07.156104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:07.157484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dfa9b-b9aa-4f6d-a6f9-57c08eabf600 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:07.167901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 956/1903] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:07.242578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:07.631700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:07.633408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:07.716162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09edcde-0a4b-40c8-9694-3755dc50b1ca admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:07.721501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:07.722674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:07.726070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:07.726070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] PATH_INFO: `/v3/projects/db1d1651b24947778f1b24f33ad110ad` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:07.726070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1d1651b24947778f1b24f33ad110ad)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:07.726878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:07.899967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1d1651b24947778f1b24f33ad110ad', 'request_id': 'req-09e7766e-dbd1-42c0-aa32-e7f4128380f5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:07.906302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1d1651b24947778f1b24f33ad110ad', 'request_id': 'req-09e7766e-dbd1-42c0-aa32-e7f4128380f5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:08.011250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1d1651b24947778f1b24f33ad110ad', 'request_id': 'req-09e7766e-dbd1-42c0-aa32-e7f4128380f5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:08.050099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] The token cache is being invalidate because project db1d1651b24947778f1b24f33ad110ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:08.053626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:08.055870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-09e7766e-dbd1-42c0-aa32-e7f4128380f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:08.061019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 948/1904] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:07 2022] DELETE /identity/v3/projects/db1d1651b24947778f1b24f33ad110ad => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:08.066766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530490-6eea-41d4-b667-324588327566 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.068203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530490-6eea-41d4-b667-324588327566 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.068203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71530490-6eea-41d4-b667-324588327566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.087212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-71530490-6eea-41d4-b667-324588327566 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:08.089193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-71530490-6eea-41d4-b667-324588327566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:08.164642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 957/1905] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:08.173771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.174124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.174413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.193118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:08.194363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:08.203333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 949/1906] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:08.208529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530490-6eea-41d4-b667-324588327566 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.218788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71530490-6eea-41d4-b667-324588327566 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.223780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.224495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.224790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.225071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.225819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:08.226698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.227785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.242649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 958/1907] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:08.253457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.266297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d37a365-c25d-42f7-b412-ef6e58a5122e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.272048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.272952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.273389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.273945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.274861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.278098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.432788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 950/1908] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:08 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:08.437276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.448554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760acf25-e60b-46ad-9e2e-ccc589d5734b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.536816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.536816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.536816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.536816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.537107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.538707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.659529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 959/1909] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:08 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:08.661335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.689967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a481f06-c611-4346-b7ba-3df3a771961d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.689967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.689967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.689967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.690241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.690241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.690241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.697290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 951/1910] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:08.701808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.712317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a800ed-1719-431a-80a9-abe27a16ce31 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.718091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.718963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.719413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.719695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.720466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.722090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.749231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 960/1911] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:08.751571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.771066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4778b-beda-4b3a-8012-a558fdedcb3a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.774710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:08.775558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.775921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.776283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] PATH_INFO: `/v3/projects/cb6c03c85d614af88d78188484d712d6/users/77d3cdf7c2c447d486c7087496dd3809/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.798388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb6c03c85d614af88d78188484d712d6, user_id=77d3cdf7c2c447d486c7087496dd3809, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:08.798388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a6756b-3a1c-4885-931a-eb84e1b0feac admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:08.810797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:08.877906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:08.879599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:08.927833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 952/1912] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:08 2022] PUT /identity/v3/projects/cb6c03c85d614af88d78188484d712d6/users/77d3cdf7c2c447d486c7087496dd3809/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:08.937978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278100-dec9-4cc6-ac22-f54221da328c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:08.940723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:08.941176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:08.941483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:08.976211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] MFA Rules not processed for user `77d3cdf7c2c447d486c7087496dd3809`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:08.977802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:09.012897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:09.014185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:09.014476 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:09.014756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:09.017299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:09.056268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 953/1913] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:09.061746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:09.094311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:09.095896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:09.108020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 961/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:08 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:09.139759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3434f4-87e6-4db1-87e6-68e93609fa26 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:09.145239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:09.145989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:09.146288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:09.146557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:09.147331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:09.149357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:09.418660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 954/1915] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:09 2022] POST /identity/v3/projects => generated 367 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:09.422721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:09.437581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc9e0c-d363-40c9-a737-ae0367a5c5c7 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:09.501674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:09.502558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:09.502913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:09.503261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:09.504434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:09.506547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:09.658350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 962/1916] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:09 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:09.662434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:09.679527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c2ee3-eb7d-44c5-976a-0e24d94b84d3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:09.693595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:09.694577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:09.706396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:09.706396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:09.706396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:09.706396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:09.733928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 955/1917] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:09.750611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:09.767570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05d884-97ce-486d-bf70-bc0ca8c1d79d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:09.794571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:09.795587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:09.796259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:09.796259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] PATH_INFO: `/v3/projects/5efb3e74450849feb3454b60076c3cd7/users/c448d3651aa24fe4b5b91c4820f36f6a/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:09.828818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efb3e74450849feb3454b60076c3cd7, user_id=c448d3651aa24fe4b5b91c4820f36f6a, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:09.832067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:09.961996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 963/1918] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:09 2022] PUT /identity/v3/projects/5efb3e74450849feb3454b60076c3cd7/users/c448d3651aa24fe4b5b91c4820f36f6a/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:09.966656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:09.980902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef06e29-38a5-46c4-9952-e152491a7ef0 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:10.052348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:10.054337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:10.054337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:10.054337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:10.054662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:10.060110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea4034-2361-4240-b84d-a966fae7ebc5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:10.080795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 956/1919] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:10.084858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:10.096538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17532ab2-0bc0-4783-bd59-783b2fdace64 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:10.101254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:10.102188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:10.102468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:10.102753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] PATH_INFO: `/v3/projects/5efb3e74450849feb3454b60076c3cd7/users/c448d3651aa24fe4b5b91c4820f36f6a/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:10.105266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efb3e74450849feb3454b60076c3cd7, user_id=c448d3651aa24fe4b5b91c4820f36f6a, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:10.107984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:10.120283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 964/1920] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:10 2022] PUT /identity/v3/projects/5efb3e74450849feb3454b60076c3cd7/users/c448d3651aa24fe4b5b91c4820f36f6a/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:10.130186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:10.130473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:10.130756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:10.157716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] MFA Rules not processed for user `c448d3651aa24fe4b5b91c4820f36f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:10.158910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:10.178071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:10.230803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 957/1921] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:10 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:10.242595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:10.244358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:10.302906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed081d3a-684e-4087-89d6-cd1418fbb676 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:10.307024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:10.307684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:10.307972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:10.308252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:10.322704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:10.322704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:10.329816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 965/1922] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:10.351514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:10.669433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:10.687107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf5e15-5c21-4bc1-a71e-8d2f35ca384b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:10.697881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:10.703620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:10.703620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:10.703620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:10.843344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:10.844826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:10.875596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 958/1923] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:11.309428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:12.224586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:12.934194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:13.836420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:14.242015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:14.466360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:14.470186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:14.534944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf2e4-bc14-442c-acab-abe175d692db service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:14.539656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:14.540530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:14.540843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:14.541122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] PATH_INFO: `/v3/users/6fb67541e3084930a160ea61318acee3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:14.542381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb67541e3084930a160ea61318acee3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:14.544341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:14.666381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:14.778331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:14.782900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:14.794801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d1e49-b4a4-44f9-abd1-4a9d1ba1b2b1 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:14.799651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:14.800816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:14.801262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:14.801691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] PATH_INFO: `/v3/users/b3faad848e0a48768cfd057565b67a3d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:14.803158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3faad848e0a48768cfd057565b67a3d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:14.805299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:14.858978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb67541e3084930a160ea61318acee3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:14.881462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb67541e3084930a160ea61318acee3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:14.937550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:15.012540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb67541e3084930a160ea61318acee3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.013240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb67541e3084930a160ea61318acee3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.024079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-df8441b9-512b-4041-98fd-9a26875623ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb67541e3084930a160ea61318acee3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.047075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 966/1924] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:14 2022] DELETE /identity/v3/users/6fb67541e3084930a160ea61318acee3 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:15.051070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:15.051454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:15.054774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:15.059082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3faad848e0a48768cfd057565b67a3d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.079819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3faad848e0a48768cfd057565b67a3d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.089481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:15.090129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:15.094738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3faad848e0a48768cfd057565b67a3d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.096826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3faad848e0a48768cfd057565b67a3d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.099947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-37deb589-c68e-4a4d-8b24-9f95cb2c8266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3faad848e0a48768cfd057565b67a3d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:15.169212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 967/1925] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:15.195828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:15.207668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:15.215344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 959/1926] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:14 2022] DELETE /identity/v3/users/b3faad848e0a48768cfd057565b67a3d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:15.221302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:15.221609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:15.221914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:15.267068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:15.267068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:15.282297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a26af-0013-4264-a1ea-5d572858c8b2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:15.360776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:15.361882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:15.362227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:15.362509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:15.366997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 960/1927] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:15.377604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:15.379763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:15.384304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:15.386969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:15.392609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 968/1928] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:15.399997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23792698-19ec-4421-9584-c98fa4a7ae2e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:15.404407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:15.405098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:15.405380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:15.405908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:15.419855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:15.420367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:15.432253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 961/1929] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:16.009371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:16.010994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:16.028953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbeb97-9fad-46b5-a8b0-81419e78df95 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:16.041133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:16.042040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:16.042324 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:16.042607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] PATH_INFO: `/v3/projects/b5aab27e83e04db99651063efacf606c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:16.046561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5aab27e83e04db99651063efacf606c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:16.048842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:16.099408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:16.101121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:16.119941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469f33a-099b-40c3-8833-f7c3d0e2d10c service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:16.138983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:16.138983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:16.138983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:16.138983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] PATH_INFO: `/v3/projects/1bce53dd9a0f4bf796a5ea1da297a649` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:16.140096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bce53dd9a0f4bf796a5ea1da297a649)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:16.140096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:16.179060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5aab27e83e04db99651063efacf606c', 'request_id': 'req-7618ee65-bf9a-4451-8af2-7bb6553cd37b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.187354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5aab27e83e04db99651063efacf606c', 'request_id': 'req-7618ee65-bf9a-4451-8af2-7bb6553cd37b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.230275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:16.259108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5aab27e83e04db99651063efacf606c', 'request_id': 'req-7618ee65-bf9a-4451-8af2-7bb6553cd37b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.274626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] The token cache is being invalidate because project b5aab27e83e04db99651063efacf606c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:16.275773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.276616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.279483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 969/1930] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:16 2022] DELETE /identity/v3/projects/b5aab27e83e04db99651063efacf606c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:16.281605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bce53dd9a0f4bf796a5ea1da297a649', 'request_id': 'req-785b87f2-e2ae-4597-b366-a404daee9408'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.284056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:16.286880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:16.288761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bce53dd9a0f4bf796a5ea1da297a649', 'request_id': 'req-785b87f2-e2ae-4597-b366-a404daee9408'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.355368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bce53dd9a0f4bf796a5ea1da297a649', 'request_id': 'req-785b87f2-e2ae-4597-b366-a404daee9408'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.373579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] The token cache is being invalidate because project 1bce53dd9a0f4bf796a5ea1da297a649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:16.373885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.375249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.377428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 962/1931] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:16 2022] DELETE /identity/v3/projects/1bce53dd9a0f4bf796a5ea1da297a649 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:16.381548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:16.386699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:16.395574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7618ee65-bf9a-4451-8af2-7bb6553cd37b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:16.490040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b87f2-e2ae-4597-b366-a404daee9408 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:16.490471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:16.491443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:16.491730 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:16.492023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] PATH_INFO: `/v3/users/47a228d9e3924b9c985af7fd60d57812` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:16.493290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a228d9e3924b9c985af7fd60d57812)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:16.495791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:16.506286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:16.507375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:16.510547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:16.510547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] PATH_INFO: `/v3/users/453817fc04c246a884e517117f8e4dee` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:16.510547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=453817fc04c246a884e517117f8e4dee)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:16.512360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:16.627000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:16.661718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a228d9e3924b9c985af7fd60d57812'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.678218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a228d9e3924b9c985af7fd60d57812'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.697739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453817fc04c246a884e517117f8e4dee'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.709804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453817fc04c246a884e517117f8e4dee'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.716749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453817fc04c246a884e517117f8e4dee'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.717504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453817fc04c246a884e517117f8e4dee'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.718156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453817fc04c246a884e517117f8e4dee'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.813160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a228d9e3924b9c985af7fd60d57812'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.813328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a228d9e3924b9c985af7fd60d57812'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.821318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a228d9e3924b9c985af7fd60d57812'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:16.827780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 970/1932] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:16 2022] DELETE /identity/v3/users/47a228d9e3924b9c985af7fd60d57812 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:16.933894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 963/1933] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:16 2022] DELETE /identity/v3/users/453817fc04c246a884e517117f8e4dee => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:17.313085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:17.314757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:17.411903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ba87c-b00c-4bbb-a5cf-1035320484de admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:17.485138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:17.486306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:17.486485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:17.486826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] PATH_INFO: `/v3/projects/43cb8c2276ec400ea1a1df1d9ddff1e9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:17.488322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43cb8c2276ec400ea1a1df1d9ddff1e9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:17.490300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:17.635259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43cb8c2276ec400ea1a1df1d9ddff1e9', 'request_id': 'req-8137297b-ae82-4d18-ab2a-b88ddb8bc070'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.645735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43cb8c2276ec400ea1a1df1d9ddff1e9', 'request_id': 'req-8137297b-ae82-4d18-ab2a-b88ddb8bc070'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.666217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:17.668505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:17.685804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932d4b3-0c58-4bbd-832d-edfb0934c867 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:17.761973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43cb8c2276ec400ea1a1df1d9ddff1e9', 'request_id': 'req-8137297b-ae82-4d18-ab2a-b88ddb8bc070'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.783967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] The token cache is being invalidate because project 43cb8c2276ec400ea1a1df1d9ddff1e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:17.784271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.788764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.793795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 971/1934] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:17 2022] DELETE /identity/v3/projects/43cb8c2276ec400ea1a1df1d9ddff1e9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:17.797229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:17.799947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:17.806902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:17.808153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:17.808634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:17.809392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] PATH_INFO: `/v3/projects/5d9cba38e07c48609b3322db6b3f51de` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:17.812667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d9cba38e07c48609b3322db6b3f51de)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:17.814877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:17.817473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137297b-ae82-4d18-ab2a-b88ddb8bc070 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:17.823698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:17.824755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:17.825194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:17.825792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] PATH_INFO: `/v3/users/4f9a3cf1ea7240ce9fa141182a55a563` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:17.827371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9a3cf1ea7240ce9fa141182a55a563)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:17.832217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:17.942997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d9cba38e07c48609b3322db6b3f51de', 'request_id': 'req-78951dd1-f5be-4169-aa43-28f657f946d4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:17.952795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d9cba38e07c48609b3322db6b3f51de', 'request_id': 'req-78951dd1-f5be-4169-aa43-28f657f946d4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.052871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d9cba38e07c48609b3322db6b3f51de', 'request_id': 'req-78951dd1-f5be-4169-aa43-28f657f946d4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.068563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] The token cache is being invalidate because project 5d9cba38e07c48609b3322db6b3f51de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:18.068853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.069526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-78951dd1-f5be-4169-aa43-28f657f946d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.071285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 964/1935] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:17 2022] DELETE /identity/v3/projects/5d9cba38e07c48609b3322db6b3f51de => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:18.072615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9a3cf1ea7240ce9fa141182a55a563'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.075994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117947-97ce-44a5-b528-884eb295ce84 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.076576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117947-97ce-44a5-b528-884eb295ce84 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.076727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6117947-97ce-44a5-b528-884eb295ce84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.091146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9a3cf1ea7240ce9fa141182a55a563'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.097078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f6117947-97ce-44a5-b528-884eb295ce84 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:18.098327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f6117947-97ce-44a5-b528-884eb295ce84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.170307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 965/1936] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:18.176634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.176972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.177245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.198595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:18.198595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.201447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9a3cf1ea7240ce9fa141182a55a563'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.202089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9a3cf1ea7240ce9fa141182a55a563'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.205799 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 966/1937] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:18.211237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9a3cf1ea7240ce9fa141182a55a563'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.216934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.217727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 972/1938] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:17 2022] DELETE /identity/v3/users/4f9a3cf1ea7240ce9fa141182a55a563 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:18.228916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece3855-c12c-4f46-9ec3-38fca16e5fd2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.288949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.289620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.289940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.290217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.291627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:18.291877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.293482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.309382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 967/1939] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:18.310608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.312107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.312880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.315391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.325569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53739b-cbeb-4649-ba81-114001707cc6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.330328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c0cb1-065f-4c83-9023-0717b045225a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.330571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.331518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.331869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.332149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] PATH_INFO: `/v3/users/77d3cdf7c2c447d486c7087496dd3809` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.333343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d3cdf7c2c447d486c7087496dd3809)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.335300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.335407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.335976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.342216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.342216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.342216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.342216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.510026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 968/1940] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:18.511082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.575566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a9da4-c2e7-41b8-ad5a-dd069ab61a86 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.580420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.581635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.582329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.582674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.583435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.586124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.610021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d3cdf7c2c447d486c7087496dd3809'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.621807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d3cdf7c2c447d486c7087496dd3809'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.659440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:18.670322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 969/1941] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:18.670322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.670322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.683309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746171e9-20bb-414b-82b4-010ed36b4d14 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.688336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.689188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.689474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.689754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] PATH_INFO: `/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.691009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ce0c5b70264b1bb2651bd0dbb8bb47)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.693135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.721208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d3cdf7c2c447d486c7087496dd3809'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.721903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d3cdf7c2c447d486c7087496dd3809'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.730733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d3cdf7c2c447d486c7087496dd3809'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.737317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 973/1942] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:18 2022] DELETE /identity/v3/users/77d3cdf7c2c447d486c7087496dd3809 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:18.738215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.739660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.803738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559791db-3102-45e4-bbcf-2bf34fd8d14f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.807927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ce0c5b70264b1bb2651bd0dbb8bb47', 'request_id': 'req-543b1611-48ca-4035-b80d-a25959800f98'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.813268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ce0c5b70264b1bb2651bd0dbb8bb47', 'request_id': 'req-543b1611-48ca-4035-b80d-a25959800f98'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.863701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.864379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.864660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.864933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.865664 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.867282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7550770b-f384-497b-9255-1c1bba5a0bc0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.880456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 974/1943] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:18.880456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.880456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.880456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.897301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:18.898535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.907175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 975/1944] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:18.907963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.911979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ce0c5b70264b1bb2651bd0dbb8bb47', 'request_id': 'req-543b1611-48ca-4035-b80d-a25959800f98'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.919275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f503b95-c627-4974-bdfd-390c9a766048 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:18.924526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:18.925240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.925605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.925980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.926788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:18.928486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132a4be-0cc1-4fea-8edc-ebf034df6a7a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:18.930157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] The token cache is being invalidate because project 16ce0c5b70264b1bb2651bd0dbb8bb47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:18.930442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.931185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:18.932905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 970/1945] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:18 2022] DELETE /identity/v3/projects/16ce0c5b70264b1bb2651bd0dbb8bb47 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:18.933822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.935295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.939812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 976/1946] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:18.941276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:18.941627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:18.941995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:18.961924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:18.963840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.976490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 977/1947] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:18.977497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:18.987037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:18.999736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eacacb-dc9d-4bb4-b7ca-e5e1d6d99bc2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.005650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.006584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.006863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.007133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] PATH_INFO: `/v3/projects/c5a55935a80142da8f03372ec174b80b/users/69d5d2b74a614cb2a7d4b48f73b9a2d8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.015441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1611-48ca-4035-b80d-a25959800f98 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.019839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.020613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.021055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.021459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.023809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.024456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a55935a80142da8f03372ec174b80b, user_id=69d5d2b74a614cb2a7d4b48f73b9a2d8, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.027745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d5c04-630a-4a95-abd9-6e7bf89873bc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.038032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.039504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe872ed2-45ce-497f-ba0a-954ec75937a8 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.049809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 971/1948] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:19.051157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.051430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.051711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.070728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:19.072529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.081176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 972/1949] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:19.085262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.094814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cddc8-5667-4f81-98b3-83149d2313fc None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.099764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.100412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.100698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.100977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.101696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:19.102052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.103756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.115462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 973/1950] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:19.120193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.130028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbe536-4760-473c-a0f3-8de3a03016b7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.135465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.136100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.136383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.136667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.137375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.139272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.184796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 978/1951] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:18 2022] PUT /identity/v3/projects/c5a55935a80142da8f03372ec174b80b/users/69d5d2b74a614cb2a7d4b48f73b9a2d8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:19.195767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.196054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.196331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.223812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] MFA Rules not processed for user `69d5d2b74a614cb2a7d4b48f73b9a2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:19.225063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.256404 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 974/1952] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:19.261185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.270164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:19.318638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 979/1953] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:19.324220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.364956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a4b75-c5da-4321-9e6c-523d8a70b21e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.370593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.371357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.371722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.372075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.372843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.375171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.413475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c11d18-f4fe-42e3-9212-41250c101e74 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.419407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.420104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.420398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.420712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.421453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.423428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.500026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 975/1954] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:19.504296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.515715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395315dd-cd9c-4687-b8e5-e3e937fa2cb6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.520579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.521325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.521612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.521951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.522711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.524332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.539751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 976/1955] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:19.543452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 980/1956] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:19.544293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.545037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.550393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.577095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb34247-dd92-464a-8749-4df4e92543d1 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.626806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d0d52-9d62-4c6e-ad20-bd9b7fc5ff1a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.631744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.632434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.632719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.632996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.634060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.635743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.641285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.642236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.642522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.642797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] PATH_INFO: `/v3/projects/cb6c03c85d614af88d78188484d712d6` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.644005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb6c03c85d614af88d78188484d712d6)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.646158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.647412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 981/1957] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:19.648169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.659368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1f01c-e8e5-4eac-be8f-b612df2d0bdc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.664282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.665029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.665384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.666272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.667040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.669179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.756249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 982/1958] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:19 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:19.757260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.768325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb6c03c85d614af88d78188484d712d6', 'request_id': 'req-f5556075-64ba-4524-9a9d-67a5c2609c38'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:19.769809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ed380-175d-41d8-8dc0-a9b7dd6ebfe1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.774535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb6c03c85d614af88d78188484d712d6', 'request_id': 'req-f5556075-64ba-4524-9a9d-67a5c2609c38'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:19.827028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.828209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.828500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.828783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] PATH_INFO: `/v3/projects/ceaf3c003ad741d4b0619e8e2224041b/users/b996c3afdc8542669f37065a6da98ba0/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.843611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ceaf3c003ad741d4b0619e8e2224041b, user_id=b996c3afdc8542669f37065a6da98ba0, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.847394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.863978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb6c03c85d614af88d78188484d712d6', 'request_id': 'req-f5556075-64ba-4524-9a9d-67a5c2609c38'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:19.877664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] The token cache is being invalidate because project cb6c03c85d614af88d78188484d712d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:19.878364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:19.879037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:19.880621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 977/1959] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:19 2022] DELETE /identity/v3/projects/cb6c03c85d614af88d78188484d712d6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:19.883775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.883775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.895196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5556075-64ba-4524-9a9d-67a5c2609c38 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.900495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.901232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.901527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.901789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.902535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.904120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.910149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:19.914406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 978/1960] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:19.915219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:19.917610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:19.930434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d971a-af8d-4e0c-871a-e42d5c3747ec admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:19.935191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:19.937452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:19.937752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:19.938213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] PATH_INFO: `/v3/users/c448d3651aa24fe4b5b91c4820f36f6a` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:19.939311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c448d3651aa24fe4b5b91c4820f36f6a)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:19.941220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:19.943972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 983/1961] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:19 2022] PUT /identity/v3/projects/ceaf3c003ad741d4b0619e8e2224041b/users/b996c3afdc8542669f37065a6da98ba0/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:19.947160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.018553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1145bb-3ec2-434c-a923-3bd0e22adec2 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.023346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.024235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.024519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.025311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] PATH_INFO: `/v3/projects/81acade52c844f0e91beaae862eb7de0/users/e16665c3ead74122a2d2a2394bee7837/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.042668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81acade52c844f0e91beaae862eb7de0, user_id=e16665c3ead74122a2d2a2394bee7837, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.045400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0972f8-fba9-4c92-a5a1-1c50d60816a0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.129658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 984/1962] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:19 2022] PUT /identity/v3/projects/81acade52c844f0e91beaae862eb7de0/users/e16665c3ead74122a2d2a2394bee7837/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:20.131271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.131809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.132213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.137919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c448d3651aa24fe4b5b91c4820f36f6a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:20.153419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c448d3651aa24fe4b5b91c4820f36f6a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:20.170279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c448d3651aa24fe4b5b91c4820f36f6a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:20.171009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c448d3651aa24fe4b5b91c4820f36f6a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:20.171644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c448d3651aa24fe4b5b91c4820f36f6a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:20.171967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] MFA Rules not processed for user `b996c3afdc8542669f37065a6da98ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:20.173511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.247651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 985/1963] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:20.248502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.250111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.250759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 979/1964] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:19 2022] DELETE /identity/v3/users/c448d3651aa24fe4b5b91c4820f36f6a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:20.265923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.268181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.325300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cc1e6-72ac-4c14-bedc-4d8ae99041c9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.362161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735398-5253-41f0-b391-efe2691d24bd admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.367168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.368035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.369527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.370009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.395831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.396513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.396801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.397085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.397886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.399447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.409787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 986/1965] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:20.413701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.426787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe9344-f210-4b6f-9ab2-0fbf80f3040a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.432118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.433253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.433382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.433553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] PATH_INFO: `/v3/projects/81acade52c844f0e91beaae862eb7de0/users/e16665c3ead74122a2d2a2394bee7837/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.435453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.435772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81acade52c844f0e91beaae862eb7de0, user_id=e16665c3ead74122a2d2a2394bee7837, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.437024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f2c8e-af86-4f7f-97ca-07f9bdbd3237 service glance] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.438457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.448100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 980/1966] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:20.452477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 987/1967] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:20 2022] PUT /identity/v3/projects/81acade52c844f0e91beaae862eb7de0/users/e16665c3ead74122a2d2a2394bee7837/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:20.463024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.463317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.463600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.496192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] MFA Rules not processed for user `e16665c3ead74122a2d2a2394bee7837`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:20.497489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.576767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 981/1968] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:20.589600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.591691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.647165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:20.657184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516565f4-691b-45b9-8a9e-03290a55b035 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.664515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.666058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.666528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.666972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.680478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.682434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.695721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 988/1969] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:20.804344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.804785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:20.804889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.886146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:20.896201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8696a7d-91e9-4449-b6da-f21e5f70093d service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.902685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dab3e6-b4c3-4e55-993d-3802b236beaf None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:20.902842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.903521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.903901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.904468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.906134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:20.914467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:20.916288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:20.916463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:20.916903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] PATH_INFO: `/v3/projects/5efb3e74450849feb3454b60076c3cd7` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:20.918318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efb3e74450849feb3454b60076c3cd7)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.921191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.977609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:20.979784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608f5a7-1407-499b-9b4f-b9be529e7f18 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:20.989976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 989/1970] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:21.039096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efb3e74450849feb3454b60076c3cd7', 'request_id': 'req-7a64067c-4657-4c16-9071-be0cca6997af'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.045390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efb3e74450849feb3454b60076c3cd7', 'request_id': 'req-7a64067c-4657-4c16-9071-be0cca6997af'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.114634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efb3e74450849feb3454b60076c3cd7', 'request_id': 'req-7a64067c-4657-4c16-9071-be0cca6997af'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.127907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] The token cache is being invalidate because project 5efb3e74450849feb3454b60076c3cd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:21.129660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.131649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7a64067c-4657-4c16-9071-be0cca6997af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.133237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 982/1971] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:20 2022] DELETE /identity/v3/projects/5efb3e74450849feb3454b60076c3cd7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:21.139201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.139496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.139770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.159148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:21.160371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:21.261104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 990/1972] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:21.263643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.267025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.267025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.298354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:21.298354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:21.305001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 983/1973] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:21.310089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.324124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a6c1-9059-4190-8ac7-8b9e7ddbac2c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.332161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.333420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.333420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.333613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.335193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:21.335193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.336845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.350395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 991/1974] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:21.355154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.365411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50f827-ac81-4a8f-a316-ffaf771d9fa8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.372452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.373218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.379543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.379543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.379543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.379543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.536361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 984/1975] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:21 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:21.540497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.569024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5514f-ea4d-4728-b597-e54c27aa9055 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.569129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.570826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:21.637689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.638778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.639362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.647236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.647236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.647236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.658207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cc5c3-f485-4dcc-9ca1-f3a9468a8279 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.663014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.663888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.664230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.664523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] PATH_INFO: `/v3/users/69d5d2b74a614cb2a7d4b48f73b9a2d8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.666306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d5d2b74a614cb2a7d4b48f73b9a2d8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.668274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.795905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 992/1976] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:21 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:21.800031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.810835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670302f0-a943-4cc6-9260-26f66ed55177 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.816929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.818034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.818328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.818942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.819692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.821387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.832785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 993/1977] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:21.836697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.847185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496aebe-99d3-4c8d-a0f8-57ed8b48bd36 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.852139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.852859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.853141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.853421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.854190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.855896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.867498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 994/1978] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:21.873701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:21.885714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec6c17-4b7a-4d17-9081-07bbb6136dfd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:21.890892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:21.892184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.892184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.892444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] PATH_INFO: `/v3/projects/163b0d7b3b904f0399d572720b02fecd/users/ce9a9660b79048908d100e43f7835ea7/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:21.911298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] RBAC: Authorizing `identity:create_grant(project_id=163b0d7b3b904f0399d572720b02fecd, user_id=ce9a9660b79048908d100e43f7835ea7, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:21.914144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc4767-6fda-4baa-95b5-5ff3c059376c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:21.922908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d5d2b74a614cb2a7d4b48f73b9a2d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.929058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:21.937258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d5d2b74a614cb2a7d4b48f73b9a2d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.944293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d5d2b74a614cb2a7d4b48f73b9a2d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.945034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d5d2b74a614cb2a7d4b48f73b9a2d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.945837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-9c491988-84a9-4c8d-bde4-44c122209b19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d5d2b74a614cb2a7d4b48f73b9a2d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:21.972879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 995/1979] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:21 2022] PUT /identity/v3/projects/163b0d7b3b904f0399d572720b02fecd/users/ce9a9660b79048908d100e43f7835ea7/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:21.989656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:21.989656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:21.989656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.014126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] MFA Rules not processed for user `ce9a9660b79048908d100e43f7835ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:22.015595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.031002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 985/1980] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:21 2022] DELETE /identity/v3/users/69d5d2b74a614cb2a7d4b48f73b9a2d8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:22.035887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:22.036004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:22.036254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.054458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:22.058625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.097635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 996/1981] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:22.111322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:22.112211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.127684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 986/1982] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:22.138646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:22.140402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.203018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29b98b-444b-4548-b024-d5aafb09e405 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:22.214476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3eac79-7411-4174-afb6-c4d5b00a4dc5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:22.219171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:22.220137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:22.220613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:22.221218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.232204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:22.235522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:22.262980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 987/1983] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:22.272328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:22.273268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:22.273679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:22.274184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.404533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:22.406754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc226dd-6a4e-4f5f-beaa-88a3e011cbdc service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:22.427402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 997/1984] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:22.477335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:22.477335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.500110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e4758-3a1a-4391-adcd-aeb1d57963b1 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:22.511766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:22.537909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:22.537909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:22.537909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] PATH_INFO: `/v3/users/ce9a9660b79048908d100e43f7835ea7` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.537909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9a9660b79048908d100e43f7835ea7)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:22.537909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:22.739102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9a9660b79048908d100e43f7835ea7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:22.749315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:22.756472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9a9660b79048908d100e43f7835ea7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:22.780897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9a9660b79048908d100e43f7835ea7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:22.781817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9a9660b79048908d100e43f7835ea7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:22.782472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9a9660b79048908d100e43f7835ea7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:22.871341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 988/1985] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:22 2022] DELETE /identity/v3/users/ce9a9660b79048908d100e43f7835ea7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:22.876115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:22.876414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:22.876721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:22.897810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:22.900511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.964922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:22.965457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 998/1986] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:22.971744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:22.979665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:22.981088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:23.015434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959426f-e793-453e-b47e-e9383937995f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:23.028467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:23.029353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:23.029638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:23.029947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] PATH_INFO: `/v3/projects/c5a55935a80142da8f03372ec174b80b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:23.032284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a55935a80142da8f03372ec174b80b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:23.034270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:23.084652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7acdbe-5e68-450d-9233-644991688700 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:23.089008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:23.089674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:23.089992 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:23.090574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:23.101449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:23.103074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:23.115891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 999/1987] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:23.188498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a55935a80142da8f03372ec174b80b', 'request_id': 'req-47c5211f-82a0-4dba-bba2-19e984e15996'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.197891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a55935a80142da8f03372ec174b80b', 'request_id': 'req-47c5211f-82a0-4dba-bba2-19e984e15996'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.262878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a55935a80142da8f03372ec174b80b', 'request_id': 'req-47c5211f-82a0-4dba-bba2-19e984e15996'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.274587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] The token cache is being invalidate because project c5a55935a80142da8f03372ec174b80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:23.274891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.283299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.283299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 989/1988] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:22 2022] DELETE /identity/v3/projects/c5a55935a80142da8f03372ec174b80b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:23.283516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:23.292474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a7240-6570-4c8a-8f6c-9aad8cbda4e4 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:23.351932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:23.353321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:23.353613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:23.353922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] PATH_INFO: `/v3/users/e16665c3ead74122a2d2a2394bee7837` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:23.355482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16665c3ead74122a2d2a2394bee7837)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:23.358024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:23.619330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16665c3ead74122a2d2a2394bee7837'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.644985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16665c3ead74122a2d2a2394bee7837'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.661497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:23.663308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:23.678317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5211f-82a0-4dba-bba2-19e984e15996 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:23.684692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:23.688955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:23.688955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:23.688955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] PATH_INFO: `/v3/projects/163b0d7b3b904f0399d572720b02fecd` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:23.688955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=163b0d7b3b904f0399d572720b02fecd)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:23.690196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:23.738420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16665c3ead74122a2d2a2394bee7837'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.739103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16665c3ead74122a2d2a2394bee7837'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.748031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0b8cdcd3-aef9-4a8d-b80a-c7c5f6b103ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16665c3ead74122a2d2a2394bee7837'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.754839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1000/1989] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:23 2022] DELETE /identity/v3/users/e16665c3ead74122a2d2a2394bee7837 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:23.762905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:23.826227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '163b0d7b3b904f0399d572720b02fecd', 'request_id': 'req-66404b38-9d05-4f54-82ec-6c23c0ceae01'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.834843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '163b0d7b3b904f0399d572720b02fecd', 'request_id': 'req-66404b38-9d05-4f54-82ec-6c23c0ceae01'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.938988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '163b0d7b3b904f0399d572720b02fecd', 'request_id': 'req-66404b38-9d05-4f54-82ec-6c23c0ceae01'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.968700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] The token cache is being invalidate because project 163b0d7b3b904f0399d572720b02fecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:23.970275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.971796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-66404b38-9d05-4f54-82ec-6c23c0ceae01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:23.979019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 990/1990] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:23 2022] DELETE /identity/v3/projects/163b0d7b3b904f0399d572720b02fecd => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:23.985360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:23.985652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:23.986031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.014621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:24.016308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.112277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1001/1991] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:24.120485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.120767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.121048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.140580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:24.142361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.150113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 991/1992] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:24.154989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.164884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd329-65e3-43bb-9a3e-71dd0afb850f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.170242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.170931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.176869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.176869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.176869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:24.176869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.176869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.186420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1002/1993] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:24.191061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.200458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc327b66-ea85-4ee2-971d-e05d68fe79a7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.205157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.205805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.206110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.206386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.207083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.208960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.271109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.272940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.287133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436826c4-0031-4f74-82e7-4043a7fa600c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.293578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 992/1994] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:24.293796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.294200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.294608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.294879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] PATH_INFO: `/v3/projects/81acade52c844f0e91beaae862eb7de0` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.295100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.296177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] RBAC: Authorizing `identity:delete_project(project_id=81acade52c844f0e91beaae862eb7de0)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.298736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.395414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de41561-399a-4379-8026-80d488c8c49c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.397761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.398492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.398878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.399166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.399995 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.401951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e1f40-858d-4ff9-81b3-2876a0f54418 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.476845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81acade52c844f0e91beaae862eb7de0', 'request_id': 'req-58df9d76-d41a-4229-a94b-40cf6d3bd69c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.485519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81acade52c844f0e91beaae862eb7de0', 'request_id': 'req-58df9d76-d41a-4229-a94b-40cf6d3bd69c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.491504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:24.556504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 993/1995] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:24.559292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9460-5dd6-43a3-a165-a9497f258580 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.559292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9460-5dd6-43a3-a165-a9497f258580 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.559292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9460-5dd6-43a3-a165-a9497f258580 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.560242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 994/1996] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:47:24.560710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd9460-5dd6-43a3-a165-a9497f258580 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.578057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81acade52c844f0e91beaae862eb7de0', 'request_id': 'req-58df9d76-d41a-4229-a94b-40cf6d3bd69c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.590826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] The token cache is being invalidate because project 81acade52c844f0e91beaae862eb7de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:24.591221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.591918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-58df9d76-d41a-4229-a94b-40cf6d3bd69c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.593540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1003/1997] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:24 2022] DELETE /identity/v3/projects/81acade52c844f0e91beaae862eb7de0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:24.595034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.595330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.595609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.613446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:24.614710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.631456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd9460-5dd6-43a3-a165-a9497f258580 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.636557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.637236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.637529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.637810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.638580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.640214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04e6d9-2c91-4740-91ba-68fd4afd8ad1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.651717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 995/1998] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:24.656326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.656766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.656983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.686862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1004/1999] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:24.687550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:24.688391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.688997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.690353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.710876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 996/2000] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:24.710876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.710876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.714646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246320a8-1238-4d71-85e7-bb7c84e7aa8e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.716843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.717518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.717809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.718124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.718865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.719954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499d7a72-68ff-4909-b4e8-6ca975e7e3e7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.720573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e37c2d-bcce-4cc5-803c-651d0450c6c3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.725071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.726353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.726640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.726919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] PATH_INFO: `/v3/users/325c6326312a4664a785a1b6f15001b2` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.728898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325c6326312a4664a785a1b6f15001b2)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.730922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.731691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1005/2001] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:24.733090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.733726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.733726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.752464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:24.753696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.766806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1006/2002] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:24.766806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.766806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:24.782246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919c97a-12b4-45d0-9d8c-2f68d973ac0a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.787416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.788097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.788380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.788655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.797210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.798805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.808896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1007/2003] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:24.809604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.820319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1f76a-0ea6-4a09-a92d-bf073af03ef3 service placement] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:24.826298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:24.827590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:24.827590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:24.827764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] PATH_INFO: `/v3/projects/5a9dc828ebb945b0a254574c01aaa5f3/users/3b4e94d61f904eebbe496166f290aa35/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:24.844492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9dc828ebb945b0a254574c01aaa5f3, user_id=3b4e94d61f904eebbe496166f290aa35, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:24.847415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:24.951450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325c6326312a4664a785a1b6f15001b2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.964933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325c6326312a4664a785a1b6f15001b2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.966921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1008/2004] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:24 2022] PUT /identity/v3/projects/5a9dc828ebb945b0a254574c01aaa5f3/users/3b4e94d61f904eebbe496166f290aa35/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:24.972263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325c6326312a4664a785a1b6f15001b2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.974096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325c6326312a4664a785a1b6f15001b2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.974880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325c6326312a4664a785a1b6f15001b2'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:24.976941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:24.978659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.045276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1751974-d487-4c49-870b-e4a545cfff8f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.050153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.050914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.051346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.051649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.052388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:25.052699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.054424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18073a6d-8e92-4cc2-9c56-0ffec9d5115e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.069381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1009/2005] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:25.069381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.069381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.069381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.081165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 997/2006] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:24 2022] DELETE /identity/v3/users/325c6326312a4664a785a1b6f15001b2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:25.082436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.099413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] MFA Rules not processed for user `3b4e94d61f904eebbe496166f290aa35`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:25.100654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.154697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c9b75-1376-46fc-aeaa-97ed17484f32 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.160191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.160952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.161166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.161454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.162260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.166881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.183822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1010/2007] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:25.195891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.198289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.231102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 998/2008] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:25.235275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.247710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:25.262450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcfaf3-8726-4278-83cd-3e805d163bd4 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.304043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d708588-7006-457d-9bab-55435f42224a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.309381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.317115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.317115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.317115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.317115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.317115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.317573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.317573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.317573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.317573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.376327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.377791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.388359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1011/2009] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:25.392762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.392762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.405339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96b47-3a81-4a8c-87fd-c56488454aa7 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.410167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.415030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.415030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.415030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] PATH_INFO: `/v3/projects/df012bbc54554a56bef75b8f9868a191` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.415030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df012bbc54554a56bef75b8f9868a191)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.415030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.423042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 999/2010] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:25.424035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.436103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202c69-3d3b-4316-ab62-13bd6de05354 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.441098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.441870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.442422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.442589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.443403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.445191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.456487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1000/2011] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:25.461289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.471354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70c54b4-1515-46f0-8366-496069f634c4 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.476349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.477135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.477424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.477735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.478510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.480579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.491614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1001/2012] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:25.496459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.510746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab2112e-4aad-431c-854a-4fc02ec650e6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.527733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df012bbc54554a56bef75b8f9868a191', 'request_id': 'req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:25.535602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df012bbc54554a56bef75b8f9868a191', 'request_id': 'req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:25.575573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.576532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.576834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.577106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] PATH_INFO: `/v3/projects/446e90bc8fa04dc59d1966a3186ca212/users/e4546ba2b2ea4a3b82d4f4f9d01986e9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.592669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446e90bc8fa04dc59d1966a3186ca212, user_id=e4546ba2b2ea4a3b82d4f4f9d01986e9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.596488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97194d-fec3-4afc-b2ec-0f4cd14c07c7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.618969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df012bbc54554a56bef75b8f9868a191', 'request_id': 'req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:25.631105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] The token cache is being invalidate because project df012bbc54554a56bef75b8f9868a191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:25.631475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:25.632197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5ca3acc6-cd9e-4457-b64a-c9ff899a59f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:25.634261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1012/2013] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:25 2022] DELETE /identity/v3/projects/df012bbc54554a56bef75b8f9868a191 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:25.639182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc710-6af2-403c-9cd5-9f9d142d8b90 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.639587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc710-6af2-403c-9cd5-9f9d142d8b90 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.639817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dc710-6af2-403c-9cd5-9f9d142d8b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.659360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-351dc710-6af2-403c-9cd5-9f9d142d8b90 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:25.660589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-351dc710-6af2-403c-9cd5-9f9d142d8b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.669368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1013/2014] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:25.678326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.678326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.678326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.682997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1002/2015] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:25 2022] PUT /identity/v3/projects/446e90bc8fa04dc59d1966a3186ca212/users/e4546ba2b2ea4a3b82d4f4f9d01986e9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:25.693100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.693393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.693673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.707247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:25.708534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.730377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] MFA Rules not processed for user `e4546ba2b2ea4a3b82d4f4f9d01986e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:25.731888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.787507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1014/2016] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:25.792553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.802837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdb79d5-130d-4683-ae0b-2d9563a05f8c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.807876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1003/2017] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:25.811010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=27,keystone:SELECT=70,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:25.815054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.815343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.815941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.816287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.816704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.816874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:25.817662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:25.818088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.823554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.837173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1015/2018] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:25.846612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.848209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a485bea-0882-41b2-8ae5-de19a1060d44 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.853916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.854588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.854878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.855156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.855866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.857805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.878582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d68d764-8140-451b-a84c-3574b6ac175e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:25.882151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:25.882804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:25.883125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:25.883657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:25.892405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:25.893835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:25.903815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1004/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:25.950971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1016/2020] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:25.955261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:25.967034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380817a-2478-47f6-a415-c5dbaf591a7c service glance] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:26.053821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:26.054592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.054880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.055159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.056134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:26.058666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:26.175193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1005/2021] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:25 2022] POST /identity/v3/users => generated 284 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:26.176360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:26.186732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9991799-f8e2-4580-8df2-975ea913b6f1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:26.191450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:26.192211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.192517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.193315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.203570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:26.205226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:26.219670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1017/2022] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:26.221239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:26.231947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026a6e7-25e2-496e-ac6e-c05a542db79f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:26.236949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:26.237636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.237994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.238224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.239126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:26.240908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff1801-6a18-47d3-a4a2-e649debef875 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:26.251501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1006/2023] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:26.255618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:26.266601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507c9dc6-afd7-4e3b-9af4-39427947a0ba admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:26.271399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:26.272280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.272624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.272846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] PATH_INFO: `/v3/projects/53aa5259d3f44d0e832264d197adaa85/users/718dba4bdacc42c395e5e615944f829a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.289019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aa5259d3f44d0e832264d197adaa85, user_id=718dba4bdacc42c395e5e615944f829a, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:26.291776 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:26.377544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1018/2024] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:26 2022] PUT /identity/v3/projects/53aa5259d3f44d0e832264d197adaa85/users/718dba4bdacc42c395e5e615944f829a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:26.388616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1113-ed57-41a7-b132-52a804aa13ba None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.395683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1113-ed57-41a7-b132-52a804aa13ba None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.395683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1113-ed57-41a7-b132-52a804aa13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.416713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f01e1113-ed57-41a7-b132-52a804aa13ba None None] MFA Rules not processed for user `718dba4bdacc42c395e5e615944f829a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:26.418702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f01e1113-ed57-41a7-b132-52a804aa13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:26.436081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:26.485207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1007/2025] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:26.496007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:26.497821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:26.561487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af738f9-89dd-4305-b4ff-fce44e927924 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:26.565286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:26.565981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:26.566270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:26.566548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:26.575831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:26.578091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:26.589217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1019/2026] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:26.995500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:27.104605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf262a-ba7a-488f-8fe3-38b73b764c70 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:27.105039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf262a-ba7a-488f-8fe3-38b73b764c70 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:27.105152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf262a-ba7a-488f-8fe3-38b73b764c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:27.123540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4cbf262a-ba7a-488f-8fe3-38b73b764c70 None None] MFA Rules not processed for user `3b4e94d61f904eebbe496166f290aa35`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:27.124809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4cbf262a-ba7a-488f-8fe3-38b73b764c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:27.185781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1008/2027] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:27.669743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:27.966093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:28.760855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:29.150320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:29.498423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:29.983677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:30.183857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:30.276037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:30.943259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:31.240819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:31.275013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:31.932669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:32.052603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:32.652425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:32.812116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:33.150148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:33.285596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:33.526634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:37.482953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:37.546075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:37.550190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac37bf-cacf-4fa2-8908-11e9f788b8ad service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:37.554819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:37.555716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:37.555999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:37.556274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] PATH_INFO: `/v3/users/718dba4bdacc42c395e5e615944f829a` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:37.562518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=718dba4bdacc42c395e5e615944f829a)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:37.562518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:37.797983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718dba4bdacc42c395e5e615944f829a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:37.810524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718dba4bdacc42c395e5e615944f829a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:37.891412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718dba4bdacc42c395e5e615944f829a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:37.892081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718dba4bdacc42c395e5e615944f829a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:37.901612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718dba4bdacc42c395e5e615944f829a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:37.908696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1020/2028] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:37 2022] DELETE /identity/v3/users/718dba4bdacc42c395e5e615944f829a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:37.913413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:37.913906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:37.914103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:37.932169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:37.933375 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:37.995334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1009/2029] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:38.004897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:38.006343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:38.066113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10442dc-a1dc-4ddb-89a3-a6e9b9b5b17f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:38.069685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:38.070377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.070655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.071524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.081109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:38.082726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bc48-0d3b-4b09-a5c2-c8d5e2cd7368 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:38.093256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1021/2030] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:38.541087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:38.542621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:38.556316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15386eba-3bbf-4204-9869-baeedfca4d95 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:38.561336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:38.562284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.562709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.562997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] PATH_INFO: `/v3/projects/53aa5259d3f44d0e832264d197adaa85` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.572894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] RBAC: Authorizing `identity:delete_project(project_id=53aa5259d3f44d0e832264d197adaa85)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:38.572894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:38.660420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:38.675567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aa5259d3f44d0e832264d197adaa85', 'request_id': 'req-ea47902f-9071-4322-8197-78724ca115db'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:38.680947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aa5259d3f44d0e832264d197adaa85', 'request_id': 'req-ea47902f-9071-4322-8197-78724ca115db'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:38.743424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aa5259d3f44d0e832264d197adaa85', 'request_id': 'req-ea47902f-9071-4322-8197-78724ca115db'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:38.755049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] The token cache is being invalidate because project 53aa5259d3f44d0e832264d197adaa85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:38.755273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:38.755891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ea47902f-9071-4322-8197-78724ca115db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:38.757450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1010/2031] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:38 2022] DELETE /identity/v3/projects/53aa5259d3f44d0e832264d197adaa85 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:38.762596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.763072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.763172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.781636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:38.782888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:38.842847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1022/2032] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:38.850887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.851177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.851497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.871603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:38.872819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:38.881101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1011/2033] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:38.885681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:38.896513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88c034-b28c-4db1-a8ae-2a6f6bc9c483 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:38.901705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:38.902604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.902886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.903189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.903916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:38.904224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:38.905890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:38.918556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1023/2034] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:38.923232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:38.933180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd22818-9959-4b1e-8601-00405a63f646 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:38.938303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:38.939068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:38.939396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:38.939722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:38.940556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:38.943128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.007888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1012/2035] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:38 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:39.013353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.024131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6807c-bd82-453b-864a-c93b800af070 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.028464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:39.085561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.086553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.086961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.087335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.088697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.090892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.184135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1024/2036] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:39 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:39.187918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.198966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438c40-f918-4ac9-9049-5222cb739a81 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.203644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.204298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.204579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.204854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.205580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.207224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.219518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1013/2037] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:39.223382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.233370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf99420b-9e88-434e-a5b9-08202611d2a6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.238039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.238704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.238978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.239259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.239984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.241571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2792-f83b-44a0-b16e-501debce608e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.251412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1025/2038] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:39.255458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.266377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cffb4-bcbb-4fc3-8ddf-9fbcef114b7a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.270900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.271769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.272104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.272378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] PATH_INFO: `/v3/projects/c37405a7396248788e1a246f9542d9ee/users/5dfcaace79bb46f38bd6f884f6b55897/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.287565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c37405a7396248788e1a246f9542d9ee, user_id=5dfcaace79bb46f38bd6f884f6b55897, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.290330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.372555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1014/2039] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:39 2022] PUT /identity/v3/projects/c37405a7396248788e1a246f9542d9ee/users/5dfcaace79bb46f38bd6f884f6b55897/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:39.387946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.388236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.388522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.418404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] MFA Rules not processed for user `5dfcaace79bb46f38bd6f884f6b55897`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:39.419655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:39.487282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1026/2040] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:39.491747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.557477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ead56-0045-424c-8482-7d1cbc4ebae6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.562398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.563060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.563342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.563619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.564332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.566256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.651442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1015/2041] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:39 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:39.652586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.665082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7623e-5281-4308-8a5e-ff9fbb16d6a3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.723390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.724073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.724359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.724679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.725410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.727397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.829968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1027/2042] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:39 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:39.833942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.845332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda53d32-e471-47e2-80df-3986b0102009 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.850036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.850745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.851029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.851305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.852024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.853719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.864528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1016/2043] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:39.868876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:39.875129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:39.878984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9ad8e-118d-4aa0-8498-7f6a9ff0f0e7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:39.883960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:39.885444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:39.885655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:39.885958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] PATH_INFO: `/v3/projects/f8da08273aaf45e484a73ac3124858f7/users/8ca3ece0d8ce4a9495945c0534c21687/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:39.902015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8da08273aaf45e484a73ac3124858f7, user_id=8ca3ece0d8ce4a9495945c0534c21687, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:39.904645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:39.995294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1028/2044] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:39 2022] PUT /identity/v3/projects/f8da08273aaf45e484a73ac3124858f7/users/8ca3ece0d8ce4a9495945c0534c21687/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:39.999367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:40.010445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78072d8-b549-443b-8932-7d1f6125fd1e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:40.036083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:40.069307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:40.070366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:40.070733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:40.071016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:40.072259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:40.073946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82374b0-99f4-49ae-9a63-ec51e5177549 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:40.084555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1017/2045] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:40.089690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:40.100133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee04844-851f-4567-bff7-1c7234ac258e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:40.104865 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:40.110926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:40.110926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:40.110926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] PATH_INFO: `/v3/projects/f8da08273aaf45e484a73ac3124858f7/users/8ca3ece0d8ce4a9495945c0534c21687/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:40.110926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8da08273aaf45e484a73ac3124858f7, user_id=8ca3ece0d8ce4a9495945c0534c21687, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:40.110926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:40.122758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1029/2046] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:40 2022] PUT /identity/v3/projects/f8da08273aaf45e484a73ac3124858f7/users/8ca3ece0d8ce4a9495945c0534c21687/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:40.135343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:40.135891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:40.139631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:40.163543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] MFA Rules not processed for user `8ca3ece0d8ce4a9495945c0534c21687`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:40.164767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:40.233382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1018/2047] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:40.246054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:40.247771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:40.306905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347c0da-8a95-4b01-9f39-6b4a650d0219 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:40.310777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:40.311431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:40.311715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:40.311991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:40.321540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:40.323043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:40.333101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1030/2048] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:41.586487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:41.596567 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680557d-5e48-4d5c-85b6-a51e51f35f81 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:41.601352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ca3ece0d8ce4a9495945c0534c21687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8da08273aaf45e484a73ac3124858f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:41.602069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:41.602364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:41.602644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:41.605534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:41.605534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:41.605534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:41.617405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1019/2049] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:41.622030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:41.631112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cdb25-2af9-4692-b1f1-ac906412b60e service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:41.636668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ca3ece0d8ce4a9495945c0534c21687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8da08273aaf45e484a73ac3124858f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:41.637309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:41.637592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:41.637893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:41.638583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:41.640454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:41.730307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1031/2050] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:41 2022] POST /identity/v3/projects => generated 354 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:41.731613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:41.741980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e6ce3-f588-429d-b792-81a65c075093 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:41.805530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ca3ece0d8ce4a9495945c0534c21687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8da08273aaf45e484a73ac3124858f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:41.806745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:41.807032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:41.807313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:41.808046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:41.808361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:41.810051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:41.825421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1020/2051] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:41.858380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:41.869052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e98dde-d297-48b0-ad51-74df4dbf3549 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:41.874245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ca3ece0d8ce4a9495945c0534c21687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8da08273aaf45e484a73ac3124858f7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:41.875350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:41.875641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:41.875918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] PATH_INFO: `/v3/projects/e73ae3a5f0204d928141014558e7b14d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:41.877140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e73ae3a5f0204d928141014558e7b14d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:41.879154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:42.042195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e73ae3a5f0204d928141014558e7b14d', 'request_id': 'req-a6f1fe44-5707-4985-a739-3c158d8c89d0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:42.049045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e73ae3a5f0204d928141014558e7b14d', 'request_id': 'req-a6f1fe44-5707-4985-a739-3c158d8c89d0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:42.131594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e73ae3a5f0204d928141014558e7b14d', 'request_id': 'req-a6f1fe44-5707-4985-a739-3c158d8c89d0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:42.144379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] The token cache is being invalidate because project e73ae3a5f0204d928141014558e7b14d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:42.144670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:42.145335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a6f1fe44-5707-4985-a739-3c158d8c89d0 tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:42.146963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1032/2052] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:41 2022] DELETE /identity/v3/projects/e73ae3a5f0204d928141014558e7b14d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:42.718400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:42.720236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:42.755764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:42.793499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958077e-778a-4690-bac1-3fdf7d0a63cb tempest-VolumeQuotaClassesTest-1171458507 tempest-VolumeQuotaClassesTest-1171458507-project-admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:42.854683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:42.855565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:42.855845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:42.856119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] PATH_INFO: `/v3/users/5dfcaace79bb46f38bd6f884f6b55897` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:42.857313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfcaace79bb46f38bd6f884f6b55897)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:42.859272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:43.093496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfcaace79bb46f38bd6f884f6b55897'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:43.105721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfcaace79bb46f38bd6f884f6b55897'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:43.112438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfcaace79bb46f38bd6f884f6b55897'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:43.113194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfcaace79bb46f38bd6f884f6b55897'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:43.113787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfcaace79bb46f38bd6f884f6b55897'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:43.211505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1021/2053] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:42 2022] DELETE /identity/v3/users/5dfcaace79bb46f38bd6f884f6b55897 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:43.216225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:43.216687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:43.216914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:43.237300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:43.238542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:43.266473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:43.300385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1033/2054] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:43.310767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:43.312424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:43.373503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2f246-d363-4d95-86f8-d482a6db2b33 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:43.377081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:43.377730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:43.378059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:43.378339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:43.388891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:43.390385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:43.394904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:43.401513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1022/2055] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:43.852969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:43.854420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:43.867198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622d59c0-2928-405d-b2ab-a13b24c0a323 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:43.872727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:43.883979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:43.884313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:43.884707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] PATH_INFO: `/v3/projects/c37405a7396248788e1a246f9542d9ee` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:43.886276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=c37405a7396248788e1a246f9542d9ee)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:43.889185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:43.997951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c37405a7396248788e1a246f9542d9ee', 'request_id': 'req-873a8ef6-0fb7-482d-a982-a1d8e0418cec'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.004696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c37405a7396248788e1a246f9542d9ee', 'request_id': 'req-873a8ef6-0fb7-482d-a982-a1d8e0418cec'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.120343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c37405a7396248788e1a246f9542d9ee', 'request_id': 'req-873a8ef6-0fb7-482d-a982-a1d8e0418cec'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.132310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] The token cache is being invalidate because project c37405a7396248788e1a246f9542d9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:44.132594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.133516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.135093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1034/2056] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:43 2022] DELETE /identity/v3/projects/c37405a7396248788e1a246f9542d9ee => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:44.140351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:44.150554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9f778-03b9-4276-98b5-f006a034c689 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:44.205949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:44.206820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:44.207105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:44.207390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] PATH_INFO: `/v3/users/8ca3ece0d8ce4a9495945c0534c21687` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:44.208579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca3ece0d8ce4a9495945c0534c21687)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:44.210539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:44.409612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca3ece0d8ce4a9495945c0534c21687'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.422834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca3ece0d8ce4a9495945c0534c21687'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.430380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca3ece0d8ce4a9495945c0534c21687'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.431098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca3ece0d8ce4a9495945c0534c21687'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.431708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-746befa2-2c76-4695-8a90-7b3aa95516d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca3ece0d8ce4a9495945c0534c21687'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:44.550131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1023/2057] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:44 2022] DELETE /identity/v3/users/8ca3ece0d8ce4a9495945c0534c21687 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:45.007015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.008725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:45.022427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a8ef6-0fb7-482d-a982-a1d8e0418cec admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.079480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.080338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.080621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.080896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] PATH_INFO: `/v3/projects/f8da08273aaf45e484a73ac3124858f7` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.082106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8da08273aaf45e484a73ac3124858f7)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.083997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.216542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8da08273aaf45e484a73ac3124858f7', 'request_id': 'req-f064601e-ee34-46ae-ac15-8e90a08dc418'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:45.222689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8da08273aaf45e484a73ac3124858f7', 'request_id': 'req-f064601e-ee34-46ae-ac15-8e90a08dc418'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:45.225262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:45.319624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8da08273aaf45e484a73ac3124858f7', 'request_id': 'req-f064601e-ee34-46ae-ac15-8e90a08dc418'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:45.330337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] The token cache is being invalidate because project f8da08273aaf45e484a73ac3124858f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:45.336339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:45.336339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f064601e-ee34-46ae-ac15-8e90a08dc418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:45.336339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1035/2058] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:45 2022] DELETE /identity/v3/projects/f8da08273aaf45e484a73ac3124858f7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:45.340473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.340950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.341061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.358988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:45.360183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:45.420413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1024/2059] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:45.427983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.428271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.428552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.449701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:45.450973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:45.458790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1036/2060] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:45.463004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.473020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc3214-c795-498b-b1bc-aeffaf110631 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.478094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.478787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.479063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.479334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.480092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:45.480394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.482167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.494126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1025/2061] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:47:45.498950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.509428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30c172-7350-4558-89ed-8296667ca525 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.514846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.515635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.515985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.516345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.517206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.519249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.637053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1037/2062] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:45 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:45.642902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.649950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:45.653901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57dee1-ade8-46b9-8704-0a0a5a1491f2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.715026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.715759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.716050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.716337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.717028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.719050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.812142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1026/2063] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:45 2022] POST /identity/v3/users => generated 291 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:45.816153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.827048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32a69e-5312-4f65-8299-92012a1f2b6e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.831942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.832607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.832882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.833156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.833915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.835535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.846704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1038/2064] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:45.850553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.860523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8a7d14-faa6-40bb-8e63-33a45fed0ef7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.865236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.865912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.866198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.866474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.867252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.868848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f143b80e-fd2d-418f-8089-91d4c4620230 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.883596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1027/2065] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:45.884701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:45.895448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42face37-e565-4234-b650-9b9450542a0a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:45.900146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:45.901020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:45.901300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:45.901577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] PATH_INFO: `/v3/projects/9477fa7b9cb44ae2905f20a6aa8672c6/users/dd5ac9699ee746cca667de5d9a79409f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:45.921267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9477fa7b9cb44ae2905f20a6aa8672c6, user_id=dd5ac9699ee746cca667de5d9a79409f, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:45.923972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:45.999136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1039/2066] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:45 2022] PUT /identity/v3/projects/9477fa7b9cb44ae2905f20a6aa8672c6/users/dd5ac9699ee746cca667de5d9a79409f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:46.009487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.009774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.010077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.037009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] MFA Rules not processed for user `dd5ac9699ee746cca667de5d9a79409f`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:46.038492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:46.102471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1028/2067] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:46.107621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.171872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b382126f-7595-494e-b4ac-6206d011503a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.176657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.177322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.177604 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.177908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.178605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.180500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.309567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1040/2068] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:46 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:46.313493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.325047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd3b55-38cd-4535-aa8c-e502d95f22bf None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.398392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.399105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.399384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.399661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.400370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.402931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.475579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1029/2069] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:46 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:46.479693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.490744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0c124-be3e-4f1f-beb4-754ede762794 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.496291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.496967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.497305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.497590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.498358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.499957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.511426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1041/2070] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:46.517287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.523172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:46.528054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c7f6a-ab25-4b81-ab29-32d725ec5c1c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.535517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.536700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.537058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.537342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] PATH_INFO: `/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c/users/f531b13f70844f7eaa3f6d8a1732f0e7/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.553544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10e3354d0304fdebc79fcb1b8a3273c, user_id=f531b13f70844f7eaa3f6d8a1732f0e7, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.556199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.744141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1030/2071] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:46 2022] PUT /identity/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c/users/f531b13f70844f7eaa3f6d8a1732f0e7/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:46.748892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.761794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2bd44-2522-4415-9541-30347d32d45a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.828047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:46.834991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.835658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.836058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.836254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.837111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.838744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477799f9-3afa-4c28-afe9-df724c4e29a6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.852694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1042/2072] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:46.853766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:46.864910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82683dcc-a469-4e87-bd5d-7d4539142cee admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:46.871157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:46.871157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.871157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.871157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] PATH_INFO: `/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c/users/f531b13f70844f7eaa3f6d8a1732f0e7/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.873163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10e3354d0304fdebc79fcb1b8a3273c, user_id=f531b13f70844f7eaa3f6d8a1732f0e7, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:46.875833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:46.887446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1031/2073] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:46 2022] PUT /identity/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c/users/f531b13f70844f7eaa3f6d8a1732f0e7/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:46.899136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:46.899416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:46.900059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:46.937122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] MFA Rules not processed for user `f531b13f70844f7eaa3f6d8a1732f0e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:46.939484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:47.041729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1043/2074] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:47.049949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:47.052177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:47.121171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2ae8a-d506-417e-928e-04e973f922c8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:47.125053 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:47.125777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:47.126154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:47.126431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:47.140579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:47.142197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a7d365-b858-4f9d-a4b7-c2d0fb991571 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:47.152972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1032/2075] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:47.752793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:47.829640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06627d44-431d-4645-a46c-e46f74e9d1b2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:47.834239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:47.835102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:47.835377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:47.835645 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] PATH_INFO: `/v3/users/dd5ac9699ee746cca667de5d9a79409f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:47.836816 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5ac9699ee746cca667de5d9a79409f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:47.838782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:48.048071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5ac9699ee746cca667de5d9a79409f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.061135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5ac9699ee746cca667de5d9a79409f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.136812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5ac9699ee746cca667de5d9a79409f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.137363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5ac9699ee746cca667de5d9a79409f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.143152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:48.145153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5ac9699ee746cca667de5d9a79409f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.151258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1044/2076] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:47 2022] DELETE /identity/v3/users/dd5ac9699ee746cca667de5d9a79409f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:48.155968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:48.156431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:48.156525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:48.175695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:48.176910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:48.236481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1033/2077] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:48.246717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:48.248185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:48.305752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abbe12-ced8-438b-8abb-5285226e3c41 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:48.310113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:48.310757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:48.311048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:48.311325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:48.320525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:48.322044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:48.331712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1045/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:48.755832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:48.757372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:48.770047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb0355-b39c-47e9-8061-386bd500b84c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:48.774693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:48.775549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:48.775830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:48.776105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] PATH_INFO: `/v3/projects/9477fa7b9cb44ae2905f20a6aa8672c6` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:48.778906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9477fa7b9cb44ae2905f20a6aa8672c6)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:48.781419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:48.939187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9477fa7b9cb44ae2905f20a6aa8672c6', 'request_id': 'req-01197e93-5c95-4565-8d4e-6711b016b48d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.945530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9477fa7b9cb44ae2905f20a6aa8672c6', 'request_id': 'req-01197e93-5c95-4565-8d4e-6711b016b48d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:48.949461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:49.028765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9477fa7b9cb44ae2905f20a6aa8672c6', 'request_id': 'req-01197e93-5c95-4565-8d4e-6711b016b48d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.047443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] The token cache is being invalidate because project 9477fa7b9cb44ae2905f20a6aa8672c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:49.047576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.048380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.052982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1034/2079] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:48 2022] DELETE /identity/v3/projects/9477fa7b9cb44ae2905f20a6aa8672c6 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:49.054289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:49.065468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37def2d5-c0bc-46a3-bee0-e25753539c21 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:49.122666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:49.123529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:49.123817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:49.124088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] PATH_INFO: `/v3/users/f531b13f70844f7eaa3f6d8a1732f0e7` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:49.125281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f531b13f70844f7eaa3f6d8a1732f0e7)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:49.127230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:49.327596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f531b13f70844f7eaa3f6d8a1732f0e7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.340057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f531b13f70844f7eaa3f6d8a1732f0e7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.405075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f531b13f70844f7eaa3f6d8a1732f0e7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.405832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f531b13f70844f7eaa3f6d8a1732f0e7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.413090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7e281adf-1775-4d37-bb2a-6991b32f33e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f531b13f70844f7eaa3f6d8a1732f0e7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:49.419064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1046/2080] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:49 2022] DELETE /identity/v3/users/f531b13f70844f7eaa3f6d8a1732f0e7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:49.835915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:49.837696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:49.853487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01197e93-5c95-4565-8d4e-6711b016b48d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:49.917168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:49.918096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:49.918377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:49.918673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] PATH_INFO: `/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:49.919843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10e3354d0304fdebc79fcb1b8a3273c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:49.921733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.046878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10e3354d0304fdebc79fcb1b8a3273c', 'request_id': 'req-b431c5c2-2139-4ec0-8e5a-f21fcad77564'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:50.052508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10e3354d0304fdebc79fcb1b8a3273c', 'request_id': 'req-b431c5c2-2139-4ec0-8e5a-f21fcad77564'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:50.154577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10e3354d0304fdebc79fcb1b8a3273c', 'request_id': 'req-b431c5c2-2139-4ec0-8e5a-f21fcad77564'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:50.167333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] The token cache is being invalidate because project b10e3354d0304fdebc79fcb1b8a3273c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:50.167688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:50.168425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b431c5c2-2139-4ec0-8e5a-f21fcad77564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:50.170577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1035/2081] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:49 2022] DELETE /identity/v3/projects/b10e3354d0304fdebc79fcb1b8a3273c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:50.175346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.175809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.176021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.194821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:50.196034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:50.214657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:50.273802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1047/2082] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:50.281978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.282267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.282610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.301380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:50.302643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:50.311160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1036/2083] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:50.315405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.325262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f863a1f7-2e21-4b60-a19b-4b2419cc8a35 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.329956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.330616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.330902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.331177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.331989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:50.332299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.333925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.345814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1048/2084] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:50.356953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.366492 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4df5-da47-4521-b0b1-8feb7a6281d8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.371343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.372543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.372827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.373097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.373787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.375707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.510641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1037/2085] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:50 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:50.515026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.525192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b1130-ecf2-4706-83ec-da16731650d6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.586002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.586684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.586971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.587255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.587962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.589909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.689273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1049/2086] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:50 2022] POST /identity/v3/users => generated 281 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:50.690855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.701525 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa011919-8706-4e19-aa35-dbe10f03be80 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.706509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.707236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.707554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.707840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.708574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.710337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.726000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1038/2087] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:50.727104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.738305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d1a8-e396-48d5-84bd-727840d341ca admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.743169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.743835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.744150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.745833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.745833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.747456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18e6ae-25dd-47a7-a008-b0f91e73a5ad admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.757787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1050/2088] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:47:50.762294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:50.772419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a2ce4-8903-4d98-9591-4ca22231915b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:50.777134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:50.778553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.778837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.779107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] PATH_INFO: `/v3/projects/bebf2499d9db4980b8eeef0dd9fa9c33/users/b9d5ab2c97ee4ea9a2d02d15502411cd/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.794740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bebf2499d9db4980b8eeef0dd9fa9c33, user_id=b9d5ab2c97ee4ea9a2d02d15502411cd, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:50.797413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:50.914832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1039/2089] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:50 2022] PUT /identity/v3/projects/bebf2499d9db4980b8eeef0dd9fa9c33/users/b9d5ab2c97ee4ea9a2d02d15502411cd/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:50.925099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:50.925397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:50.925706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:50.953301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] MFA Rules not processed for user `b9d5ab2c97ee4ea9a2d02d15502411cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:50.954538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:51.020385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1051/2090] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:51.056251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:51.057974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:51.078204 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:51.114464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c5ccf-680d-47cc-b950-e7fe076bb096 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:51.118812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:51.119453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:51.119738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:51.120014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:51.128486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:51.129959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a3a75c-b2a2-4adc-9957-ce3725af3c65 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:51.142109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1040/2091] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:51.156789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:51.171836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:51.235272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237fac6-a7ef-49e7-b411-a1828532fc1e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:51.240675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:51.241552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:51.241836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:51.242143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] PATH_INFO: `/v3/users/b9d5ab2c97ee4ea9a2d02d15502411cd` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:51.244039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d5ab2c97ee4ea9a2d02d15502411cd)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:51.246000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:51.507074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d5ab2c97ee4ea9a2d02d15502411cd'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:51.525892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d5ab2c97ee4ea9a2d02d15502411cd'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:51.682602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d5ab2c97ee4ea9a2d02d15502411cd'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:51.682948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d5ab2c97ee4ea9a2d02d15502411cd'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:51.701702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d5ab2c97ee4ea9a2d02d15502411cd'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:51.709093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1052/2092] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:51 2022] DELETE /identity/v3/users/b9d5ab2c97ee4ea9a2d02d15502411cd => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:51.713737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:51.714082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:51.714381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:51.732514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:51.733711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:51.791838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1041/2093] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:51.801933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:51.803424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:51.865564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0f647-dbd1-4a40-8465-41feca497b8b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:51.869330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:51.870042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:51.870329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:51.870606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:51.880578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:51.882038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac8810-4ee4-4245-80d2-fdd8ce15fd1c service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:51.892151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1053/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:52.801510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:52.803050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:52.815980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a8ce9-f3ab-4dad-afa7-c60c6d614a0b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:52.820568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:52.821444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:52.821710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:52.822014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] PATH_INFO: `/v3/projects/bebf2499d9db4980b8eeef0dd9fa9c33` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:52.823202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bebf2499d9db4980b8eeef0dd9fa9c33)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:52.825767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.009271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bebf2499d9db4980b8eeef0dd9fa9c33', 'request_id': 'req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:53.016144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bebf2499d9db4980b8eeef0dd9fa9c33', 'request_id': 'req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:53.108342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bebf2499d9db4980b8eeef0dd9fa9c33', 'request_id': 'req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:53.119879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] The token cache is being invalidate because project bebf2499d9db4980b8eeef0dd9fa9c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:47:53.120164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:53.120788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0f76bed1-e423-4ace-bab0-2ff4a34bc65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:53.122898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1042/2095] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:47:52 2022] DELETE /identity/v3/projects/bebf2499d9db4980b8eeef0dd9fa9c33 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:53.127782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.128265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.128454 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.146640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:53.147819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:53.177081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:53.204944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1054/2096] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:53.212533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.212829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.213114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.232835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:53.234065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:53.242074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1043/2097] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:53.246270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.256457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b323ba3-c7f9-41af-9875-814a767a1897 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.261326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.262007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.262319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.262595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.263323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:47:53.263632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.265250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.276863 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1055/2098] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:47:53.281181 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.290750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18b796-1e4d-4c80-b99b-8322138cf077 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.296196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.296788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.297072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.297348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.298101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.299986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.373121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1044/2099] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:53.377141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.387857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf3d73-4586-466f-beb7-6234d6709a89 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.445374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.446083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.446371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.446650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.447371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.449299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.555202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1056/2100] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:53.558356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.568766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca448a-fa9b-4db5-b599-17727d8cd403 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.573448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.574163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.574454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.574754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.575494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.577096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.587494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1045/2101] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:53.591677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.601516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076016c3-32a2-499b-804c-42af8856acc6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.606881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.607522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.607800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.608071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.608787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.610595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea272c1-65e5-447f-b089-e9c66165341c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.620097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1057/2102] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:53.624067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.631015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:53.635752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bb1ef-4547-49c1-a988-db8ffd49c1de admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.642020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.642919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.643245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.643689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] PATH_INFO: `/v3/projects/d48b3481d3f94360b00f280ad0d95e9b/users/f79503594c794ca48108ec2f814117c9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.659907 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48b3481d3f94360b00f280ad0d95e9b, user_id=f79503594c794ca48108ec2f814117c9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.662614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:53.737865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1046/2103] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:53 2022] PUT /identity/v3/projects/d48b3481d3f94360b00f280ad0d95e9b/users/f79503594c794ca48108ec2f814117c9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:53.748013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.748304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.748593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.776753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] MFA Rules not processed for user `f79503594c794ca48108ec2f814117c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:53.778005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:53.845208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1058/2104] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:53.849746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:53.912883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547745e-d111-4797-a388-f2dbabc82569 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:53.917836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:53.918521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:53.918814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:53.919092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:53.919830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:53.921774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.010612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1047/2105] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:47:53 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:47:54.011760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.023644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea8e8-c5eb-461b-abf6-f64796e4e6dd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.055844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:54.099063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.099938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.100223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.100888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.101626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.103750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.211567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1059/2106] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:47:54 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:47:54.215539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.226462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8ecb1-25b5-4ff8-8838-9b25d4c62c26 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.231023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.231679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.231965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.232241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.232973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.234606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.245094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1048/2107] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:54.249726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.262001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237206a0-0138-413f-8774-91653a9263bc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.265644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.266945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.267204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.267472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] PATH_INFO: `/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe/users/2a50183f3f0f40558dcdc8d2464b4db5/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.284628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbabddd93c48cf9c20f50dfb8edffe, user_id=2a50183f3f0f40558dcdc8d2464b4db5, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.287472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.375941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1060/2108] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:54 2022] PUT /identity/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe/users/2a50183f3f0f40558dcdc8d2464b4db5/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:54.378437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.391193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81465eee-c4df-400b-afd6-d195a7b1dad3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.454613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.454999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.455287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.455565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.456904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.458856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7b56e1-c0c2-4213-8c84-467f9e2b1799 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.473748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1049/2109] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:47:54.477474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.488369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35776c39-41c9-4ba0-980d-ce21bd72ad06 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.493192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.494209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.494563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.494905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] PATH_INFO: `/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe/users/2a50183f3f0f40558dcdc8d2464b4db5/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.497021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cfbabddd93c48cf9c20f50dfb8edffe, user_id=2a50183f3f0f40558dcdc8d2464b4db5, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.501582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.516681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1061/2110] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:47:54 2022] PUT /identity/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe/users/2a50183f3f0f40558dcdc8d2464b4db5/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:54.527700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f47f-2402-498b-9502-623d137698f1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.528139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f47f-2402-498b-9502-623d137698f1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.530312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44f47f-2402-498b-9502-623d137698f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.557415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-4c44f47f-2402-498b-9502-623d137698f1 None None] MFA Rules not processed for user `2a50183f3f0f40558dcdc8d2464b4db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:54.558750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-4c44f47f-2402-498b-9502-623d137698f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:54.601195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:54.630061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1050/2111] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:54.642008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:54.643909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:54.701372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66890b43-4df6-4e29-91b8-2bd2fc7dfcb2 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:54.705016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:54.705650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:54.705975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:54.706253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:54.761789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:54.763280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:54.772242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1062/2112] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:47:55.897549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae726e-3938-4490-928a-b2f35660f21f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:55.898044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae726e-3938-4490-928a-b2f35660f21f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:55.898165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae726e-3938-4490-928a-b2f35660f21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:55.915752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6eae726e-3938-4490-928a-b2f35660f21f None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:55.916940 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6eae726e-3938-4490-928a-b2f35660f21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:55.971479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1051/2113] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:47:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:56.014855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:56.016656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:56.061994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:56.089976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734b5f1-2f61-4c41-9bcb-f4a96f04c1bc service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:56.095625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:56.096306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:56.096603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:56.096869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:56.105182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:56.106842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:56.115175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1063/2114] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:47:57.108038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3158-2502-4390-9087-6a5a95edd3ab None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:57.108473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3158-2502-4390-9087-6a5a95edd3ab None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:57.108602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b3158-2502-4390-9087-6a5a95edd3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:57.125943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c68b3158-2502-4390-9087-6a5a95edd3ab None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:57.127141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c68b3158-2502-4390-9087-6a5a95edd3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:57.134596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1052/2115] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:47:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:57.147335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:57.158822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bbb38-5021-43f9-9e7d-3646b3c19b50 service swift] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:57.164059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:57.164691 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:57.164974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:57.165278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:57.173751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:57.175358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:57.183802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1064/2116] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:47:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:47:57.975714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6fea-acc9-4ded-9aa6-5868937eac21 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:57.976024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6fea-acc9-4ded-9aa6-5868937eac21 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:57.976287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd6fea-acc9-4ded-9aa6-5868937eac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:57.994874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-26fd6fea-acc9-4ded-9aa6-5868937eac21 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:57.996086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-26fd6fea-acc9-4ded-9aa6-5868937eac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:58.006119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1053/2117] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:47:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:58.017183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:58.028319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deef3ed-b807-4308-b549-21d08779524d service swift] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:58.033947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:58.034804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:58.035163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:58.035537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:58.052528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:58.054246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:58.064762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1065/2118] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:47:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 03:47:59.016718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.017198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.017297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.036645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:59.037782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.045155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1054/2119] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:47:59.062090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:59.068359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3154-3b04-44ec-a222-34be2c98cede service swift] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:59.073451 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:59.074115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.074399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.074695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.083921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:59.085365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:59.093692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1066/2120] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:47:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:47:59.123731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:59.125180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.192478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8cff7-9661-45f6-96de-ba8f446d6953 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:59.197252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:59.198190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.198476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.198751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] PATH_INFO: `/v3/users/e4546ba2b2ea4a3b82d4f4f9d01986e9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.199953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4546ba2b2ea4a3b82d4f4f9d01986e9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:59.201866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:59.243132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:59.254505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0523db-1c2f-441b-9eec-8bb5b338c92c service swift] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:59.259333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:59.262200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.262200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.262200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] PATH_INFO: `/v3/users/f79503594c794ca48108ec2f814117c9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.262200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f79503594c794ca48108ec2f814117c9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:59.263859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:59.520683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4546ba2b2ea4a3b82d4f4f9d01986e9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.532709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f79503594c794ca48108ec2f814117c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.533651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:59.535050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4546ba2b2ea4a3b82d4f4f9d01986e9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.541787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4546ba2b2ea4a3b82d4f4f9d01986e9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.542636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4546ba2b2ea4a3b82d4f4f9d01986e9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.543254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-92f86132-a5da-4a90-a8af-08c9ecffc7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4546ba2b2ea4a3b82d4f4f9d01986e9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.547066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f79503594c794ca48108ec2f814117c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.663772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1055/2121] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:59 2022] DELETE /identity/v3/users/e4546ba2b2ea4a3b82d4f4f9d01986e9 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:47:59.668101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.668572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.668860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.687075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:59.688318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.748381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f79503594c794ca48108ec2f814117c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.749036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f79503594c794ca48108ec2f814117c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.751977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1056/2122] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:59.761840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:59.763405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.768647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-3dd855d7-833b-4324-aea2-a932d6b95a4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f79503594c794ca48108ec2f814117c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:47:59.775029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1067/2123] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:47:59 2022] DELETE /identity/v3/users/f79503594c794ca48108ec2f814117c9 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:47:59.783311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.783618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.783903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.811977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:47:59.811977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.841493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584850-c2d6-4e52-9b6f-850641ff4d25 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:59.877710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:47:59.887655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1068/2124] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:47:59.898057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:47:59.899437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.904444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:59.905173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.905527 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.905894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.908580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:47:59.916842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb30a2c-3604-47b9-b48f-8091057ff77c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:47:59.921679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:59.923087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:47:59.923229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:59.923931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:47:59.924310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:47:59.924840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:47:59.933190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1057/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:47:59.935922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:47:59.937959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:47:59.949886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1069/2126] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:00.459540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:00.462033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:00.465702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:00.468232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:00.493141 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d913d-36be-45ce-9a7d-5246016319aa service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:00.498151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:00.498916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b11ce3-f9ec-4758-8cbe-454c8bfe4db7 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:00.499755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:00.500229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:00.500853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] PATH_INFO: `/v3/projects/d48b3481d3f94360b00f280ad0d95e9b` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:00.502296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48b3481d3f94360b00f280ad0d95e9b)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:00.504463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:00.504605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:00.505680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:00.506193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:00.510822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] PATH_INFO: `/v3/projects/446e90bc8fa04dc59d1966a3186ca212` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:00.510822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] RBAC: Authorizing `identity:delete_project(project_id=446e90bc8fa04dc59d1966a3186ca212)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:00.510822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:00.664330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48b3481d3f94360b00f280ad0d95e9b', 'request_id': 'req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.678062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48b3481d3f94360b00f280ad0d95e9b', 'request_id': 'req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.817426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48b3481d3f94360b00f280ad0d95e9b', 'request_id': 'req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.828317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:00.834290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] The token cache is being invalidate because project d48b3481d3f94360b00f280ad0d95e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:00.834573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.835401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.837101 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1070/2127] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:00 2022] DELETE /identity/v3/projects/d48b3481d3f94360b00f280ad0d95e9b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:00.840970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:00.842497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446e90bc8fa04dc59d1966a3186ca212', 'request_id': 'req-44dc9fbd-169e-4486-afd2-81d51efa633f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.842762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:00.849019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446e90bc8fa04dc59d1966a3186ca212', 'request_id': 'req-44dc9fbd-169e-4486-afd2-81d51efa633f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.914452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446e90bc8fa04dc59d1966a3186ca212', 'request_id': 'req-44dc9fbd-169e-4486-afd2-81d51efa633f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.917332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8fa7b-ff8a-4ff5-97b0-aa54c4782a83 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:00.936841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] The token cache is being invalidate because project 446e90bc8fa04dc59d1966a3186ca212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:00.937399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.938651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-44dc9fbd-169e-4486-afd2-81d51efa633f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:00.949383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1058/2128] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:00 2022] DELETE /identity/v3/projects/446e90bc8fa04dc59d1966a3186ca212 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:00.958667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e6b4-8bfc-4061-82a9-7e545b679260 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:00.959043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e6b4-8bfc-4061-82a9-7e545b679260 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:00.959395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3051e6b4-8bfc-4061-82a9-7e545b679260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:00.985676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3051e6b4-8bfc-4061-82a9-7e545b679260 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:00.999853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3051e6b4-8bfc-4061-82a9-7e545b679260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:01.024652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.026294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.026598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.026868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] PATH_INFO: `/v3/users/2a50183f3f0f40558dcdc8d2464b4db5` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.028309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a50183f3f0f40558dcdc8d2464b4db5)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.030424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.056234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:01.077418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1059/2129] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:01.085551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.088341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.088341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.103444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:01.104642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:01.113063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1060/2130] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:01.119597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.126274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f2b2-77eb-4bb1-ad98-c0f315c036fa None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.131320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.132111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.132394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.132716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.133705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:01.134049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.135674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.152603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1061/2131] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:48:01.153570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.163460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeb6b0-3fc4-4ebe-a04f-71523644ae04 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.168192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.168830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.169118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.169403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.170133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.172019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.185210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a50183f3f0f40558dcdc8d2464b4db5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:01.197302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a50183f3f0f40558dcdc8d2464b4db5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:01.279103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a50183f3f0f40558dcdc8d2464b4db5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:01.279757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a50183f3f0f40558dcdc8d2464b4db5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:01.289276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1062/2132] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:01 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:01.291029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a50183f3f0f40558dcdc8d2464b4db5'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:01.291197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.291936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:01.294245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1071/2133] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:00 2022] DELETE /identity/v3/users/2a50183f3f0f40558dcdc8d2464b4db5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:01.358899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805091bd-3ae2-42b9-b894-5930b1cb1999 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.419128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.419804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.420109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.420379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.421102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.423630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.529657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1063/2134] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:01 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:48:01.533061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.544158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c88b-7823-4e0d-8d97-cda2bb1de4da admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.553057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.553674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.553996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.554275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.555012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.556647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.567804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1072/2135] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:01.571851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.581953 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829fe72b-65a1-49ae-9bfd-0b77fa4ec225 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.586841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.587560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.587919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.588198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.588928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.590561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.601887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1064/2136] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:01.604907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.615635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c36be-ec29-4186-8869-a5da500f99d0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.620234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.621144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.621428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.621703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] PATH_INFO: `/v3/projects/cda7b4104a8c4aff82daa2bc15ba0b40/users/96a9496d3032465485ecd7becfb98f61/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.639045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda7b4104a8c4aff82daa2bc15ba0b40, user_id=96a9496d3032465485ecd7becfb98f61, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.641728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e3bda-3862-48f5-9f6d-f32a3d300582 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:01.708578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:01.881273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1073/2137] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:01 2022] PUT /identity/v3/projects/cda7b4104a8c4aff82daa2bc15ba0b40/users/96a9496d3032465485ecd7becfb98f61/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:01.882521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:01.884864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:01.892905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.893274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.893607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.908042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231495ce-fc41-45fb-9d1c-f8868f96372d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:01.926388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] MFA Rules not processed for user `96a9496d3032465485ecd7becfb98f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:01.928298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:01.992581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:01.993443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:01.993725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:01.994034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] PATH_INFO: `/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:01.995889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cfbabddd93c48cf9c20f50dfb8edffe)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:01.998921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.042370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1074/2138] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:02.043412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.045305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.097452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cfbabddd93c48cf9c20f50dfb8edffe', 'request_id': 'req-11e212e6-9bb1-4192-9088-20f59cdd0556'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.105036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cfbabddd93c48cf9c20f50dfb8edffe', 'request_id': 'req-11e212e6-9bb1-4192-9088-20f59cdd0556'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.122658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3962d9-43b1-4be0-b8e3-3413634f8496 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.129289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:02.165192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cfbabddd93c48cf9c20f50dfb8edffe', 'request_id': 'req-11e212e6-9bb1-4192-9088-20f59cdd0556'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.179935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] The token cache is being invalidate because project 8cfbabddd93c48cf9c20f50dfb8edffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:02.180218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.180869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.182571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1065/2139] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:01 2022] DELETE /identity/v3/projects/8cfbabddd93c48cf9c20f50dfb8edffe => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:48:02.183711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.184789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.187360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.188106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.188884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.189160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.190981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.248793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:02.251659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.252951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e212e6-9bb1-4192-9088-20f59cdd0556 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.253085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5360dd5-fb8a-4593-8940-eed84dc35c12 service glance] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.257741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.258984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.259248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.259516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] PATH_INFO: `/v3/users/3b4e94d61f904eebbe496166f290aa35` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.260763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b4e94d61f904eebbe496166f290aa35)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.262846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.262968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1075/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:02.264138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125c61c-4ad8-4716-9383-7f7ea4549577 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.264327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125c61c-4ad8-4716-9383-7f7ea4549577 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.264568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125c61c-4ad8-4716-9383-7f7ea4549577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.290633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c125c61c-4ad8-4716-9383-7f7ea4549577 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:02.295619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c125c61c-4ad8-4716-9383-7f7ea4549577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.304353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1076/2141] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:02.311622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.312058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.312338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.333295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:02.334399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.343235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1077/2142] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:02.352425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.365467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a88c5b-93f4-45dd-8b39-c4369f6cf95e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.371680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.372713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.373152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.373620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.374988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:02.375303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.377409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.397893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1078/2143] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:48:02.401158 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.411989 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f66475-1e0b-4c98-a266-509321fabeac admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.417202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.417889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.418181 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.418458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.419221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.421127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.445547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b4e94d61f904eebbe496166f290aa35'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.459342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b4e94d61f904eebbe496166f290aa35'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.466891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b4e94d61f904eebbe496166f290aa35'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.467649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b4e94d61f904eebbe496166f290aa35'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.468286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-02f86d4f-4de8-424a-968e-374baed71b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b4e94d61f904eebbe496166f290aa35'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:02.552036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1079/2144] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:02 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:02.553091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.554911 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.576735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1066/2145] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:02 2022] DELETE /identity/v3/users/3b4e94d61f904eebbe496166f290aa35 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:02.581627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.581949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.582233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.599804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:02.600990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.623348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84f9f6-a51b-4cf8-a769-7c26eed3b35d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.640644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:02.665169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1067/2146] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:02.674636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.676019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:02.683217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.683935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.684216 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.684490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.685186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.687555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.733251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46531e5f-4322-40c4-b53b-6b930376c209 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.737559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.738235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.738519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.738793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.747773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.749195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.754797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:02.760134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1068/2147] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:48:02.806373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1080/2148] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:02 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:02.806478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.817428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9530-1412-43af-b2a6-291802ae0409 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.822933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.823991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.824118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.824327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.825057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.836642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.841448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1069/2149] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:48:02.842735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.855362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db483-8eba-4c3f-88c2-335fa514d135 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.860847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.861760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.862125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.862457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.863242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.865403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:02.876783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1081/2150] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:48:02.881054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:02.894997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6c80b-455c-4da7-95c4-354d1717cf20 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:02.900540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:02.901688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:02.902114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:02.902897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] PATH_INFO: `/v3/projects/d82cb0d4666c4e109337ca0fe6b1057e/users/3e999d6235d542489aad7a09e31c5a25/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:02.924297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82cb0d4666c4e109337ca0fe6b1057e, user_id=3e999d6235d542489aad7a09e31c5a25, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:02.927255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232af123-99f1-4284-a5a6-7452a96d73e7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:03.046760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:03.048834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1070/2151] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:02 2022] PUT /identity/v3/projects/d82cb0d4666c4e109337ca0fe6b1057e/users/3e999d6235d542489aad7a09e31c5a25/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:03.049107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:03.076585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:03.077023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:03.077423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:03.083124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27380e44-69c6-4cd9-9778-8f87a18e25d0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:03.113826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] MFA Rules not processed for user `3e999d6235d542489aad7a09e31c5a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:03.113826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:03.145726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:03.146684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:03.146968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:03.147249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] PATH_INFO: `/v3/projects/5a9dc828ebb945b0a254574c01aaa5f3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:03.148446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9dc828ebb945b0a254574c01aaa5f3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:03.150401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:03.182241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1071/2152] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:03.193902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:03.199077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:03.264555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d271d9-8700-4e80-b19f-ff8e3b3cfe4b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:03.282183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9dc828ebb945b0a254574c01aaa5f3', 'request_id': 'req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:03.288526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9dc828ebb945b0a254574c01aaa5f3', 'request_id': 'req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:03.319565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:03.320354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:03.320642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:03.320921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:03.359573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9dc828ebb945b0a254574c01aaa5f3', 'request_id': 'req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:03.367060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:03.377502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] The token cache is being invalidate because project 5a9dc828ebb945b0a254574c01aaa5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:03.378071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:03.378932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:03.380869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1082/2153] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:03 2022] DELETE /identity/v3/projects/5a9dc828ebb945b0a254574c01aaa5f3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:48:03.407701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:03.409551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:03.420538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1072/2154] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:48:07.240953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:07.242544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:07.277874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:07.312624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32585e-1b4a-4139-8b9f-fb6cec457cd7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:07.317293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:07.318281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:07.318778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:07.319251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] PATH_INFO: `/v3/users/b996c3afdc8542669f37065a6da98ba0` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:07.320830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b996c3afdc8542669f37065a6da98ba0)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:07.322797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:07.549670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b996c3afdc8542669f37065a6da98ba0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.562104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b996c3afdc8542669f37065a6da98ba0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.620093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:07.631228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4fc84-eeba-435a-a256-82637fdbd2c2 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:07.643131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:07.643131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:07.643131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:07.643131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] PATH_INFO: `/v3/users/3e999d6235d542489aad7a09e31c5a25` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:07.643597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e999d6235d542489aad7a09e31c5a25)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:07.643597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:07.673631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b996c3afdc8542669f37065a6da98ba0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.674320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b996c3afdc8542669f37065a6da98ba0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.689191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a1a2c7f0-4bb8-448b-b5a4-5562e28e3c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b996c3afdc8542669f37065a6da98ba0'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.689191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1083/2155] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:07 2022] DELETE /identity/v3/users/b996c3afdc8542669f37065a6da98ba0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:07.693503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:07.693731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:07.694045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:07.711526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:07.712891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:07.774144 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1084/2156] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:07.783572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:07.785072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:07.842757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:07.846360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7df04-fa8f-453e-8df5-add5a819f147 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:07.850157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:07.850806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:07.851092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:07.851363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:07.861369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:07.862856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c95e32-9b09-44b8-99fc-0ec74965de02 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:07.872516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1085/2157] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:48:07.921819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e999d6235d542489aad7a09e31c5a25'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.939185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e999d6235d542489aad7a09e31c5a25'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.948101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e999d6235d542489aad7a09e31c5a25'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.948802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e999d6235d542489aad7a09e31c5a25'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:07.949423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e999d6235d542489aad7a09e31c5a25'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.079456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1073/2158] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:07 2022] DELETE /identity/v3/users/3e999d6235d542489aad7a09e31c5a25 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:48:08.083913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.084254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.084537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.103363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:08.104563 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.177899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1086/2159] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:08.188049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:08.190163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.252363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f8080-2ab4-496a-9b81-bee5dcc32009 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:08.256304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:08.256973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.257421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.257588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.267949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:08.271333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769edaf3-d93b-423a-b492-ca92f51e90a1 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:08.280092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1074/2160] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:08.361152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:08.363413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.388066 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3869e01-46c6-4cba-ba1d-9abc851b3803 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:08.398773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:08.398773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.398773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.398773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] PATH_INFO: `/v3/projects/ceaf3c003ad741d4b0619e8e2224041b` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.399534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ceaf3c003ad741d4b0619e8e2224041b)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:08.400993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:08.573642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ceaf3c003ad741d4b0619e8e2224041b', 'request_id': 'req-2b072957-06ee-4325-acc0-38aca35048a3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.580856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ceaf3c003ad741d4b0619e8e2224041b', 'request_id': 'req-2b072957-06ee-4325-acc0-38aca35048a3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.702198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ceaf3c003ad741d4b0619e8e2224041b', 'request_id': 'req-2b072957-06ee-4325-acc0-38aca35048a3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.714337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] The token cache is being invalidate because project ceaf3c003ad741d4b0619e8e2224041b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:08.714659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.715326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b072957-06ee-4325-acc0-38aca35048a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:08.717007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1087/2161] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:08 2022] DELETE /identity/v3/projects/ceaf3c003ad741d4b0619e8e2224041b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:08.722397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.723065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.723241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.745880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:08.745880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.778954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:08.804541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1075/2162] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:08.812317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.812630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.812944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.832264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:08.833461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.841898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1088/2163] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:08.846800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:08.863032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:08.865127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:08.866906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3cf5e7-6448-4a3b-b309-e3265675cb39 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:08.878493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:08.879175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.879468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.880212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.882595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:08.882595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:08.888237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f599e9-ca63-4a6d-83a7-729a6171aa88 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:08.888755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:08.890631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:08.892661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.892746 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.893035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] PATH_INFO: `/v3/projects/d82cb0d4666c4e109337ca0fe6b1057e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.894489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82cb0d4666c4e109337ca0fe6b1057e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:08.896507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:08.897541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1076/2164] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:48:08.902004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:08.913558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2fe98-394f-48f2-8f5d-db151676cee8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:08.919169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:08.919974 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:08.920330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:08.920697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:08.921919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:08.925171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.020268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82cb0d4666c4e109337ca0fe6b1057e', 'request_id': 'req-1cfd72c3-0fca-4615-b9c5-64287d477529'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:09.027026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82cb0d4666c4e109337ca0fe6b1057e', 'request_id': 'req-1cfd72c3-0fca-4615-b9c5-64287d477529'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:09.098275 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1077/2165] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:08 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:09.102543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.147711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82cb0d4666c4e109337ca0fe6b1057e', 'request_id': 'req-1cfd72c3-0fca-4615-b9c5-64287d477529'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:09.150172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:09.160367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] The token cache is being invalidate because project d82cb0d4666c4e109337ca0fe6b1057e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:09.160661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:09.161327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1cfd72c3-0fca-4615-b9c5-64287d477529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:09.163172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1089/2166] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:08 2022] DELETE /identity/v3/projects/d82cb0d4666c4e109337ca0fe6b1057e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:09.167864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a669-3be3-4f7d-a01c-9987041e2cf7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.168153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a669-3be3-4f7d-a01c-9987041e2cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.168441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378a669-3be3-4f7d-a01c-9987041e2cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.170880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7c626-5d69-4356-9d94-b94276d229e5 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.176253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.177072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.177370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.177655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.178432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.180388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.188164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3378a669-3be3-4f7d-a01c-9987041e2cf7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:09.189999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3378a669-3be3-4f7d-a01c-9987041e2cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:09.198296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1090/2167] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:09.207440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.207729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.208013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.226761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:09.228035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:09.238405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1091/2168] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:09.242497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.252487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3692ed7-04dc-4a09-b89d-9c9ce06472df None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.257002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.258428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.258428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.258654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.259336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:09.259643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.261557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.274715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1092/2169] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:48:09.278762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.289210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f938a12-6e27-4d0d-8bb1-71eb9b5c6f41 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.291134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1078/2170] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:09.294325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.295048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.295175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.295357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.295591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.296276 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.296955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:09.298177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.310915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8199f0-742b-404b-b5ea-75943858003e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.316721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.317916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.327503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.327503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.327503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.327503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.332167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1079/2171] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:48:09.336592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.346290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa7568-bf18-4e14-893c-08d824c7a19e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.351993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.358175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.358175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.358175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.358175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.358175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.367334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1080/2172] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:48:09.371364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.382267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f875d4-97f0-4c75-a39b-b9c2e975f91e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.387685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.388351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.388631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.388926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] PATH_INFO: `/v3/projects/ad1fa6d6941e450489e617a06c16e511/users/6fb55e81e4c649b9b4df15a110af3f1c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.405322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1fa6d6941e450489e617a06c16e511, user_id=6fb55e81e4c649b9b4df15a110af3f1c, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.408541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b1ea-01dc-4d53-a5c9-2641f451b5bc admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.453360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1093/2173] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:09.457294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.522019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ce03-5d36-447a-bb83-fd7dd6647ece admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.525078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1081/2174] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:09 2022] PUT /identity/v3/projects/ad1fa6d6941e450489e617a06c16e511/users/6fb55e81e4c649b9b4df15a110af3f1c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:48:09.530286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.530590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.530902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.550313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:09.551559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:09.606364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.612526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.612526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.612526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.612526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.612526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.621379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:09.637514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1082/2175] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:48:09.650046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.651577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:09.711309 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadc449-1687-45c6-b7c5-8be48586fbd0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.715212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.715858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.716144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.716421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.727115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.728558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.740957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1094/2176] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:09 2022] POST /identity/v3/users => generated 287 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:48:09.742721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1083/2177] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:48:09.745648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.756214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403a0a1-41ab-4d06-b229-5b0d5b5a60aa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.761782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.762465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.763081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.763081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.763755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.765364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.776124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1095/2178] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:09.785777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.796110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b62e-61cd-4c08-b994-3a31e1edd0e3 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.801002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.801688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.802012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.802297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.803062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.804681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2239f0-d935-4449-b2f0-a96f95d0bd77 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:09.816922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1084/2179] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:09.819533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:09.831382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93963b-5335-4598-852e-096a8c18a21e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:09.836512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:09.837456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:09.837733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:09.838051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] PATH_INFO: `/v3/projects/dcdb210a065e48c98587624d8ab6fe39/users/c760f8414d5b4fc488005d2a8ce7139b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:09.858708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcdb210a065e48c98587624d8ab6fe39, user_id=c760f8414d5b4fc488005d2a8ce7139b, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:09.864887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:10.011643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1096/2180] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:09 2022] PUT /identity/v3/projects/dcdb210a065e48c98587624d8ab6fe39/users/c760f8414d5b4fc488005d2a8ce7139b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:10.023068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:10.023266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:10.023584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:10.052302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] MFA Rules not processed for user `c760f8414d5b4fc488005d2a8ce7139b`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:10.053735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:10.123265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1085/2181] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:10.135917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:10.137820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:10.145606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:10.208009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2ecd1-6a07-457c-a69b-b3dc348ec71d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:10.212461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:10.213154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:10.213475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:10.213912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:10.223774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:10.226060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcefcb-aef4-4cb5-ba6a-8aeb3be52fd6 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:10.236263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1097/2182] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:10.266279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:10.339700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a2afc-4891-40cf-9955-dcc45ef753fd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:10.354253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:10.355197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:10.355479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:10.368460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] PATH_INFO: `/v3/users/c760f8414d5b4fc488005d2a8ce7139b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:10.368460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c760f8414d5b4fc488005d2a8ce7139b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:10.368460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:10.373906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:10.680203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c760f8414d5b4fc488005d2a8ce7139b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:10.693441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c760f8414d5b4fc488005d2a8ce7139b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:10.700991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c760f8414d5b4fc488005d2a8ce7139b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:10.701747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c760f8414d5b4fc488005d2a8ce7139b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:10.702395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c760f8414d5b4fc488005d2a8ce7139b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:10.905433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1086/2183] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:10 2022] DELETE /identity/v3/users/c760f8414d5b4fc488005d2a8ce7139b => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:10.910234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9140da-97e5-4f28-ad3c-0aba603f0afc None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:10.910685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9140da-97e5-4f28-ad3c-0aba603f0afc None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:10.910885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9140da-97e5-4f28-ad3c-0aba603f0afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:10.930591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-2b9140da-97e5-4f28-ad3c-0aba603f0afc None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:10.931853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b9140da-97e5-4f28-ad3c-0aba603f0afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:11.004405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1098/2184] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:11.020100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:11.021633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:11.081264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bec78-189b-4ab3-b28c-0a4854d0b2b5 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:11.085211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:11.085956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:11.086243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:11.086522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:11.097177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:11.098770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:11.109226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1087/2185] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:11.715576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:11.715873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:11.716228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:11.716767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:11.718394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:11.732614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef9c7f-ddb9-4167-8876-5aea8f355b8a service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:11.739399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:11.746264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:11.746264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:11.746264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] PATH_INFO: `/v3/projects/dcdb210a065e48c98587624d8ab6fe39` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:11.746264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcdb210a065e48c98587624d8ab6fe39)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:11.746698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:11.747925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] MFA Rules not processed for user `6fb55e81e4c649b9b4df15a110af3f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:11.749224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:11.823026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1099/2186] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:11.834162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:11.835607 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:11.879737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:11.896349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12037024-6a5c-4c01-809b-7d4f26e15dca None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:11.900072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:11.900721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:11.901007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:11.901286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:11.909585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:11.911052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9845993-cb90-4b8e-8fc3-af8d65133fdf service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:11.919792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1100/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:48:11.983205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcdb210a065e48c98587624d8ab6fe39', 'request_id': 'req-75c7da8d-4c1f-4b71-8e67-5c140769ac94'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:11.989447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcdb210a065e48c98587624d8ab6fe39', 'request_id': 'req-75c7da8d-4c1f-4b71-8e67-5c140769ac94'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:12.113339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcdb210a065e48c98587624d8ab6fe39', 'request_id': 'req-75c7da8d-4c1f-4b71-8e67-5c140769ac94'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:12.125874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] The token cache is being invalidate because project dcdb210a065e48c98587624d8ab6fe39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:12.126706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:12.127350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-75c7da8d-4c1f-4b71-8e67-5c140769ac94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:12.128932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1088/2188] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:11 2022] DELETE /identity/v3/projects/dcdb210a065e48c98587624d8ab6fe39 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:12.134280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02af8-9129-4584-877a-135f490abe05 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.134504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02af8-9129-4584-877a-135f490abe05 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.134786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b02af8-9129-4584-877a-135f490abe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.153466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-64b02af8-9129-4584-877a-135f490abe05 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:12.154736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-64b02af8-9129-4584-877a-135f490abe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:12.213529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1101/2189] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:12.222505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.222802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.223105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.242433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:12.243638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:12.251570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1089/2190] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:12.256217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b02af8-9129-4584-877a-135f490abe05 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.267143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b02af8-9129-4584-877a-135f490abe05 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.271869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.272592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.272879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.273163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.273923 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:12.274265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.275924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.288891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1102/2191] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:48:12.293189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.303489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e53ec2-40e5-4561-8210-5b0e41ac9a57 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.308248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.308904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.310821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.310821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.310821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.312099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.316403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:12.395794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1090/2192] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:12 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:48:12.400121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.410703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c1dfe-4503-4283-bc9f-b79b95ec34bc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.471086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.471756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.472037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.472307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.473042 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.474979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.606411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1103/2193] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:12 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:48:12.610317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.624215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2a260-7e79-419f-bf16-3883db1ae791 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.630816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.631551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.631872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.632177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.633227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.634897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.648316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1091/2194] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:12.650543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.675745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853a101-4f67-4c16-b54f-04630b3cdf9f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.687854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.687854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.687854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.687854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.688233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.688233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b6ff8-1a2a-438c-a254-c2a882e99a00 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.696711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1104/2195] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:12.701031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:12.717270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d0380-9ab4-4c11-8dd2-a7708f0e1b29 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:12.731577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:12.733319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.733609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.735887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] PATH_INFO: `/v3/projects/73ea8eee6bc241adb52d107256fac326/users/be0356eaa6294b83b815dcbaad7e6750/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:12.765978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ea8eee6bc241adb52d107256fac326, user_id=be0356eaa6294b83b815dcbaad7e6750, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:12.765978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:12.959965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1092/2196] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:12 2022] PUT /identity/v3/projects/73ea8eee6bc241adb52d107256fac326/users/be0356eaa6294b83b815dcbaad7e6750/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:48:12.971933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04eb9-7e0f-4956-a5b6-07e73c78badb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:12.972585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04eb9-7e0f-4956-a5b6-07e73c78badb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:12.972585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb04eb9-7e0f-4956-a5b6-07e73c78badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:13.000360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ffb04eb9-7e0f-4956-a5b6-07e73c78badb None None] MFA Rules not processed for user `be0356eaa6294b83b815dcbaad7e6750`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:13.001684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ffb04eb9-7e0f-4956-a5b6-07e73c78badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:13.035908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:13.068479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1105/2197] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:13.079588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:13.081405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:13.143517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f64f2c-c022-48fa-a925-c218841c817c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:13.147211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:13.147851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:13.148133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:13.148407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:13.156608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:13.158145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be3e4a-5699-4cfa-a15a-aa017cadf5ea service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:13.167570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1093/2198] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:14.767221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:14.768266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:14.768266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:14.787575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] MFA Rules not processed for user `6fb55e81e4c649b9b4df15a110af3f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:14.788800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:14.845609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1106/2199] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:15.785273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcbdd-3a34-4aed-9236-9680effcc0e0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:15.785723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcbdd-3a34-4aed-9236-9680effcc0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:15.785885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88dcbdd-3a34-4aed-9236-9680effcc0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:15.806783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c88dcbdd-3a34-4aed-9236-9680effcc0e0 None None] MFA Rules not processed for user `9bd6f3beda094f9c9bd43862a296b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:15.807997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c88dcbdd-3a34-4aed-9236-9680effcc0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:15.863488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1094/2200] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:22.700117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:22.827220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76672ee-54c0-42bd-aa69-9d2b4b703524 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:22.833236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:22.834283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:22.834665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:22.835039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] PATH_INFO: `/v3/users/be0356eaa6294b83b815dcbaad7e6750` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:22.836415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] RBAC: Authorizing `identity:delete_user(user_id=be0356eaa6294b83b815dcbaad7e6750)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:22.838513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:23.064750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:23.069637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be0356eaa6294b83b815dcbaad7e6750'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:23.081956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be0356eaa6294b83b815dcbaad7e6750'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:23.157606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be0356eaa6294b83b815dcbaad7e6750'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:23.158254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be0356eaa6294b83b815dcbaad7e6750'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:23.165997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be0356eaa6294b83b815dcbaad7e6750'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:23.172526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1107/2201] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:22 2022] DELETE /identity/v3/users/be0356eaa6294b83b815dcbaad7e6750 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:23.177184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:23.177710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:23.177815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:23.226292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:23.227509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:23.256380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:23.288131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1095/2202] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:23.298097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:23.299661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:23.402089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac853c13-bb5c-4b54-941c-f5a87a91678d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:23.405714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:23.406394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:23.406677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:23.406955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:23.416311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:23.417732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:23.427434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1108/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:23.937382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:23.938841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:23.952679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ceaf8b-b7e6-48bd-a447-59492f654067 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:23.958202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:23.958640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:23.966036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:23.966036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] PATH_INFO: `/v3/projects/73ea8eee6bc241adb52d107256fac326` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:23.966036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ea8eee6bc241adb52d107256fac326)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:23.966036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:24.084813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ea8eee6bc241adb52d107256fac326', 'request_id': 'req-1be14d08-219c-4669-a54c-8788e2424506'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:24.090279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ea8eee6bc241adb52d107256fac326', 'request_id': 'req-1be14d08-219c-4669-a54c-8788e2424506'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:24.180989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ea8eee6bc241adb52d107256fac326', 'request_id': 'req-1be14d08-219c-4669-a54c-8788e2424506'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:24.192376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] The token cache is being invalidate because project 73ea8eee6bc241adb52d107256fac326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:24.192665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:24.193289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1be14d08-219c-4669-a54c-8788e2424506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:24.194860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1096/2204] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:23 2022] DELETE /identity/v3/projects/73ea8eee6bc241adb52d107256fac326 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:33.423252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=56,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:34.189259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:34.431109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:34.432529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:34.445318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074f4d8-c5dd-4067-ba1c-250e5c07215d service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:34.502517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:34.503425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:34.503701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:34.504004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] PATH_INFO: `/v3/users/96a9496d3032465485ecd7becfb98f61` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:34.505800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a9496d3032465485ecd7becfb98f61)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:34.508095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:34.686690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a9496d3032465485ecd7becfb98f61'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:34.699311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a9496d3032465485ecd7becfb98f61'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:34.803649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a9496d3032465485ecd7becfb98f61'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:34.807139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a9496d3032465485ecd7becfb98f61'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:34.812053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a9496d3032465485ecd7becfb98f61'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:34.818603 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1109/2205] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:48:34 2022] DELETE /identity/v3/users/96a9496d3032465485ecd7becfb98f61 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:34.823158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:34.823448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:34.823724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:34.841763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:34.843001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:34.904222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1097/2206] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:34.913827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:34.915275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:34.975820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf312a54-3b4a-4b9b-ba62-23a3fcbe3f7c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:34.979689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:34.984954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:34.984954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:34.984954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:34.993157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:34.994915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f98c2-3825-4cd8-a525-53aa32fb8b9d service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:35.006081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1110/2207] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:35.497791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:35.503444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:35.515131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0936-91ab-4be4-b6c4-04abbbb37b2f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:35.532598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:35.533426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:35.533725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:35.534087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] PATH_INFO: `/v3/projects/cda7b4104a8c4aff82daa2bc15ba0b40` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:35.535349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda7b4104a8c4aff82daa2bc15ba0b40)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:35.537344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:35.668660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda7b4104a8c4aff82daa2bc15ba0b40', 'request_id': 'req-61389949-78cc-4876-b14f-1d053ed79110'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:35.680117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda7b4104a8c4aff82daa2bc15ba0b40', 'request_id': 'req-61389949-78cc-4876-b14f-1d053ed79110'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:35.844719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda7b4104a8c4aff82daa2bc15ba0b40', 'request_id': 'req-61389949-78cc-4876-b14f-1d053ed79110'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:35.862208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] The token cache is being invalidate because project cda7b4104a8c4aff82daa2bc15ba0b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:48:35.862208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:35.862446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-61389949-78cc-4876-b14f-1d053ed79110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:48:35.864012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1098/2208] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:48:35 2022] DELETE /identity/v3/projects/cda7b4104a8c4aff82daa2bc15ba0b40 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:35.869278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:35.869758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:35.869881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:35.902713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:35.976990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:35.976990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:35.988492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1111/2209] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:35.996732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:35.997147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:35.997432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.016792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:36.018040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:36.026329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1099/2210] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:36.047633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.059392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114f81a-2f89-47b3-b810-9538ef201f09 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.066193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.073235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.082469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1112/2211] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:48:36.086883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.096317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def2a8ba-ab60-47d0-87be-00e3b4ab6e94 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.101468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.102163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.102445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.102722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.103413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.105469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.211264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1100/2212] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:48:36 2022] POST /identity/v3/projects => generated 365 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:48:36.215558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.225947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ffd-bf31-4570-84e7-34ebd7a757e0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.283833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.284510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.284786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.285059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.285758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.288204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.365565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1113/2213] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:48:36 2022] POST /identity/v3/users => generated 283 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:48:36.373322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.379764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66802a-846c-47cd-aabd-5d81ec85b771 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.384890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.385688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.385911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.386196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.386978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.388922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.405784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1101/2214] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:36.416164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.426425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55aebb2-5007-4747-9e4e-3cfafc9cc40a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.431251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.431919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.432260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.432545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.433374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.435047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1b9a9-60d4-40be-8a3b-9501ad8e2d53 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.446336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1114/2215] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:48:36.450737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.461519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c687d4-4eed-4fe8-9b88-d43b64c8bfe4 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.466227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.467108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.467423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.467720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] PATH_INFO: `/v3/projects/3f76818ea0244032a10a4a24286ce031/users/29369585fce94d91bc9e083f5db2771f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.482467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f76818ea0244032a10a4a24286ce031, user_id=29369585fce94d91bc9e083f5db2771f, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.485193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.565071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1102/2216] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:48:36 2022] PUT /identity/v3/projects/3f76818ea0244032a10a4a24286ce031/users/29369585fce94d91bc9e083f5db2771f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:48:36.578196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03802-b920-4330-b9bf-04b9b7b48e1d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.578522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03802-b920-4330-b9bf-04b9b7b48e1d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.578793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b03802-b920-4330-b9bf-04b9b7b48e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.608617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-38b03802-b920-4330-b9bf-04b9b7b48e1d None None] MFA Rules not processed for user `29369585fce94d91bc9e083f5db2771f`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:36.609774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-38b03802-b920-4330-b9bf-04b9b7b48e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:36.682469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:36.694870 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1115/2217] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:48:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:36.706399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:36.708366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:36.732291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:36.779510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac824527-1574-4bfe-b8af-3b97c444ddf9 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:36.783481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:36.784159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:36.784460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:36.784769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:36.797634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:36.799134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:36.811782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1103/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:48:46.746894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:46.857412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=17 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:48:57.976822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04020e9-eb06-4115-9d9a-ccb798b95e66 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:57.977417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04020e9-eb06-4115-9d9a-ccb798b95e66 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:57.977417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04020e9-eb06-4115-9d9a-ccb798b95e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:57.996023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c04020e9-eb06-4115-9d9a-ccb798b95e66 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:48:57.997217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c04020e9-eb06-4115-9d9a-ccb798b95e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:58.061178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1116/2219] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:48:58.085737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:48:58.087262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:48:58.189744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d9e0f-c3b7-42d0-b14a-6738f4c5613f service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:48:58.196700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:48:58.197351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:48:58.197639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:48:58.197963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:48:58.207172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:48:58.208759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:48:58.218656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1104/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:04.459297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e516-1ab9-4ca3-b249-d8826f6406da None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:04.459794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e516-1ab9-4ca3-b249-d8826f6406da None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:04.459891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658e516-1ab9-4ca3-b249-d8826f6406da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:04.480646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b658e516-1ab9-4ca3-b249-d8826f6406da None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:04.481894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b658e516-1ab9-4ca3-b249-d8826f6406da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:04.489837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1117/2221] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:04.508498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:04.509978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:04.525153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d6b9c-56a1-4a97-b11a-23ea2dc822b9 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:04.530847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:04.531389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:04.531678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:04.531960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:04.541024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:04.543235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:04.552863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1105/2222] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:10.840068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89655-01c9-4830-b115-c584a0f8b381 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:10.845764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89655-01c9-4830-b115-c584a0f8b381 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:10.845764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89655-01c9-4830-b115-c584a0f8b381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:10.858508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b3a89655-01c9-4830-b115-c584a0f8b381 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:10.859703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b3a89655-01c9-4830-b115-c584a0f8b381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:10.867975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1118/2223] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:10.892016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:10.903265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc87be-ba47-4d9a-9ade-d9db765767be service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:10.908659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:10.909284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:10.909606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:10.909906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:10.918585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:10.920149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:10.930165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1106/2224] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:49:15.951498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ccd71-fd29-4fee-96ad-fa651995c996 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:15.951982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ccd71-fd29-4fee-96ad-fa651995c996 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:15.952084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ccd71-fd29-4fee-96ad-fa651995c996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:15.969902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ea6ccd71-fd29-4fee-96ad-fa651995c996 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:15.971199 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ea6ccd71-fd29-4fee-96ad-fa651995c996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:15.979459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1119/2225] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:15.999335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:16.011231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ee9196-7b9c-4669-967f-024192105fab service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:16.016673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:16.017326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:16.017605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:16.017905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:16.026199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:16.027773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3191ab7a-dce6-46cd-ad57-9251464fae6c service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:16.037571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1107/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:20.542052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:20.542598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:20.542598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:20.559809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] MFA Rules not processed for user `0bd253c869e7428ca8765eeb8e8122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:20.561005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:20.616266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1120/2227] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:49:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:21.320785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:21.321656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:21.322202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:21.347927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:21.349163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:21.357605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1108/2228] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:21.393457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:21.405543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf5e68-7abc-4e98-a409-56791eea0d68 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:21.411606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:21.412854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:21.413309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:21.413590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:21.422415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:21.424000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:21.436324 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1121/2229] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:22.780411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:22.781891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:22.869097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:22.883771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d2f4b-5066-49ce-91ab-2510b90afb68 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:22.889051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:22.889701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:22.890031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:22.890311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:22.892187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:22.904600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:22.906445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cb3bb-e81e-4b07-892f-77f665c20048 service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:22.917021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1109/2230] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:23.088787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:23.099449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf463d-6acd-455a-9a1a-89c5de5b37fd service nova] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:23.104254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:23.105128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:23.105410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:23.105688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] PATH_INFO: `/v3/users/29369585fce94d91bc9e083f5db2771f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:23.107013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=29369585fce94d91bc9e083f5db2771f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:23.108934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:23.353675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29369585fce94d91bc9e083f5db2771f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:23.367072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29369585fce94d91bc9e083f5db2771f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:23.369596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:23.499218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29369585fce94d91bc9e083f5db2771f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:23.499839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29369585fce94d91bc9e083f5db2771f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:23.508238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29369585fce94d91bc9e083f5db2771f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:23.514235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1122/2231] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:49:23 2022] DELETE /identity/v3/users/29369585fce94d91bc9e083f5db2771f => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:49:23.519147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:23.519435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:23.519712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:23.538217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:23.538968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:23.601628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1110/2232] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:23.611179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:23.612620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:23.670857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0231-d730-48a5-b336-5e79c66448dd admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:23.674391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:23.675025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:23.675348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:23.675622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:23.686262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:23.687754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4b736-9a61-4320-8787-3a586243b796 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:23.697532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1123/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:24.283846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:24.285307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:24.297778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0da955-06d6-40df-afd6-9a0354d2dc70 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:24.302864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:24.303721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:24.304005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:24.304280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] PATH_INFO: `/v3/projects/3f76818ea0244032a10a4a24286ce031` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:24.305609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f76818ea0244032a10a4a24286ce031)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:24.307420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:24.425321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f76818ea0244032a10a4a24286ce031', 'request_id': 'req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:24.430821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f76818ea0244032a10a4a24286ce031', 'request_id': 'req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:24.476036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f76818ea0244032a10a4a24286ce031', 'request_id': 'req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:24.487061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] The token cache is being invalidate because project 3f76818ea0244032a10a4a24286ce031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:49:24.487348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:24.487970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:49:24.489498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1111/2234] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:49:24 2022] DELETE /identity/v3/projects/3f76818ea0244032a10a4a24286ce031 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:49:25.678773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8773d-b8c1-427e-9278-653bcda36bd2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:25.679615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8773d-b8c1-427e-9278-653bcda36bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:25.679902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8773d-b8c1-427e-9278-653bcda36bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:25.707651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-27d8773d-b8c1-427e-9278-653bcda36bd2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:25.708987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-27d8773d-b8c1-427e-9278-653bcda36bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:25.776576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1124/2235] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:25.795162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:25.796652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:25.887148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:25.892114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824b9c8-3c4c-4f2a-a66e-43b9b89357ae admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:25.898339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:25.898984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:25.899265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:25.899581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:25.908086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:25.909755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:25.919395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1112/2236] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:49:35.766921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=1,keystone:SELECT=59 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:36.236478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:47.637838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2845-31e8-4f51-b7a3-4affd202f97c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:47.638344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2845-31e8-4f51-b7a3-4affd202f97c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:47.638440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf2845-31e8-4f51-b7a3-4affd202f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:47.697347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-71cf2845-31e8-4f51-b7a3-4affd202f97c None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:47.698606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-71cf2845-31e8-4f51-b7a3-4affd202f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:47.764246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1125/2237] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:49:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:47.903008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:49:47.904522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:47.993775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b3c1c-8906-4641-838f-d3327dd48c11 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:49:47.999055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:49:47.999704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:47.999986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:48.000257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:48.009260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:49:48.010898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e0dee-cc70-420e-b3ce-61367646d2a5 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:49:48.018981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1113/2238] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:49:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:49:48.192632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5896f9-1f92-449f-9e6b-5d8c55424caf None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:49:48.193377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5896f9-1f92-449f-9e6b-5d8c55424caf None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:49:48.193707 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5896f9-1f92-449f-9e6b-5d8c55424caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:49:48.215407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0f5896f9-1f92-449f-9e6b-5d8c55424caf None None] MFA Rules not processed for user `6fb55e81e4c649b9b4df15a110af3f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:49:48.217657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0f5896f9-1f92-449f-9e6b-5d8c55424caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:49:48.303749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1126/2239] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:49:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:49:58.015700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=41 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:49:58.295851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=69 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:50:05.274013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.274487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.274590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.275993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1114/2240] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:50:05.282717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeba51-5410-46a2-a845-ea22ac670118 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.283219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeba51-5410-46a2-a845-ea22ac670118 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.283320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeba51-5410-46a2-a845-ea22ac670118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.327494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4abeba51-5410-46a2-a845-ea22ac670118 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:05.330904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4abeba51-5410-46a2-a845-ea22ac670118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:05.339083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1127/2241] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:05.351634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:05.353429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:05.444781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2320da-edf9-4483-80ea-40496daa02c2 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:05.448469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:05.449116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.449397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.449670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.461994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:05.475206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d90c18-3b39-47e4-82ff-7c6ee00a566c service glance] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:05.481092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1115/2242] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:05.746257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.746550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.746825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.748256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1128/2243] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:50:05.753043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3c2-6af8-4b64-9f21-8ea981e71121 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.753329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3c2-6af8-4b64-9f21-8ea981e71121 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.753605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fca3c2-6af8-4b64-9f21-8ea981e71121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.771556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-39fca3c2-6af8-4b64-9f21-8ea981e71121 None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:05.772753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-39fca3c2-6af8-4b64-9f21-8ea981e71121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:05.830036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1116/2244] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:05.842342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:05.844110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:05.858126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf11a5-3d11-46df-9311-a6ac667372fa None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:05.861727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:05.862449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.862736 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.863012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.870901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:05.872333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b031de93-a805-4cf7-8075-07e9ce3f84d6 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:05.880301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1129/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:05.964272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6507-d827-49bd-8152-1637cc3d9ab0 None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.964539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6507-d827-49bd-8152-1637cc3d9ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.964815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6507-d827-49bd-8152-1637cc3d9ab0 None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.966273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1117/2246] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:50:05.971193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762ac5-79d9-40da-b080-bfbafc28f387 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:05.971484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762ac5-79d9-40da-b080-bfbafc28f387 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:05.971873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2762ac5-79d9-40da-b080-bfbafc28f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:05.991022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d2762ac5-79d9-40da-b080-bfbafc28f387 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:05.992209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d2762ac5-79d9-40da-b080-bfbafc28f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:06.001639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1130/2247] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:50:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:06.012580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6507-d827-49bd-8152-1637cc3d9ab0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:06.024328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6507-d827-49bd-8152-1637cc3d9ab0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:06.028516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:06.029075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:06.029465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:06.029621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:06.041271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:06.042757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:06.053692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1118/2248] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:08.430152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da947-afdd-42a7-8682-7564fec30e5c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:08.430605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da947-afdd-42a7-8682-7564fec30e5c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:08.430877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3da947-afdd-42a7-8682-7564fec30e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:08.450138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-fd3da947-afdd-42a7-8682-7564fec30e5c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:08.451529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-fd3da947-afdd-42a7-8682-7564fec30e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:08.460013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1131/2249] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:08.474209 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:08.477443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:08.490910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fa2965-5beb-4712-b179-1fc5f372482d service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:08.496677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:08.497312 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:08.497592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:08.497883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:08.507932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:08.509558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:08.519259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1119/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:11.074478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a281-1c43-43c9-8862-89464b556e2d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:11.074932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a281-1c43-43c9-8862-89464b556e2d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:11.075039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576a281-1c43-43c9-8862-89464b556e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:11.100128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9576a281-1c43-43c9-8862-89464b556e2d None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:11.101352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9576a281-1c43-43c9-8862-89464b556e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:11.108726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1132/2251] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:50:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:50:11.120570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:11.132740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b2a90-92f6-4eac-a1e7-4f813a4da5ef service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:11.137909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:11.138561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:11.138849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:11.139126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:11.148449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:11.150172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:11.158487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1120/2252] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:50:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:50:13.002731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3375e2-ced5-4c36-89f4-3627f283dda7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:13.003543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3375e2-ced5-4c36-89f4-3627f283dda7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:13.003831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3375e2-ced5-4c36-89f4-3627f283dda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:13.024982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9e3375e2-ced5-4c36-89f4-3627f283dda7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:13.026301 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9e3375e2-ced5-4c36-89f4-3627f283dda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:13.034524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1133/2253] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:13.056887 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:13.069678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a72ec5-337f-4aab-b3ff-946436cd50b1 service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:13.075284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:13.075923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:13.076212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:13.076673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:13.086262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:13.087906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:13.098828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1121/2254] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:23.018218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=27 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:50:23.093553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=82 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:50:33.342978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809e02-c76e-48ac-8850-78eebd7f361b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:33.343492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809e02-c76e-48ac-8850-78eebd7f361b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:33.343652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809e02-c76e-48ac-8850-78eebd7f361b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:33.363043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-55809e02-c76e-48ac-8850-78eebd7f361b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:33.364187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-55809e02-c76e-48ac-8850-78eebd7f361b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:33.373034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1134/2255] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:50:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:33.397183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:33.409532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b432-4024-475a-a7cc-b04aa8edf101 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:33.416354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:33.420369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:33.420369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:33.420369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:33.426902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:33.429170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:33.440954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1122/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:36.270554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257c10-fdc5-4e45-9f9f-7a0a7d5aa20d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:36.271205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257c10-fdc5-4e45-9f9f-7a0a7d5aa20d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:36.271205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3257c10-fdc5-4e45-9f9f-7a0a7d5aa20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:36.292057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a3257c10-fdc5-4e45-9f9f-7a0a7d5aa20d None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:36.293249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a3257c10-fdc5-4e45-9f9f-7a0a7d5aa20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:36.300411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1135/2257] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:50:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:36.312671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:36.324346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08434ea7-d21a-4792-8705-4cbf697e9f20 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:36.329271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:36.329922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:36.330206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:36.330482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:36.339135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:36.340685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:36.348671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1123/2258] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:50:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:50:38.585939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9232-669a-46c6-96ab-2f32a77e38e6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:38.586395 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9232-669a-46c6-96ab-2f32a77e38e6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:38.586513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d9232-669a-46c6-96ab-2f32a77e38e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:38.604593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-615d9232-669a-46c6-96ab-2f32a77e38e6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:38.605785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-615d9232-669a-46c6-96ab-2f32a77e38e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:38.613688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1136/2259] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:50:38.629545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:38.641874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886ffa3-c1bb-4406-8a9f-d73544b7c47e service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:38.647620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:38.648242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:38.648523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:38.648795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:38.656988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:38.658588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:38.668834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1124/2260] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:42.830027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07a7-8309-4935-84f4-fbf31d5bee5f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:42.830496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07a7-8309-4935-84f4-fbf31d5bee5f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:42.830590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec07a7-8309-4935-84f4-fbf31d5bee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:42.848780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-daec07a7-8309-4935-84f4-fbf31d5bee5f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:42.850751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-daec07a7-8309-4935-84f4-fbf31d5bee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:42.859019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1137/2261] 10.222.0.23 () {58 vars in 1016 bytes} [Fri Jun 24 03:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:50:42.881386 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:50:42.893519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae85915-c8c8-44c6-8345-6de5e49d1b1e service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:50:42.902239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:50:42.902895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:42.903197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:42.903467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:42.912949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:50:42.914581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:50:42.924787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1125/2262] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:50:52.843657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=12 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:50:52.920079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=24 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:50:58.151539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:50:58.152031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:50:58.152120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:50:58.170005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] MFA Rules not processed for user `9bd6f3beda094f9c9bd43862a296b30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:50:58.171290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:50:58.225978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1138/2263] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:50:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:00.938365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:00.948475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d87-205e-43ca-a77c-c5aca898d50d service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:00.952321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:00.952962 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:00.953244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:00.953523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:00.955550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:00.969236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:00.972241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b5d43-bd9e-4589-b92e-b5300d2e5448 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:00.982610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1126/2264] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:01.159924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:01.169943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1702016-c340-4c02-83a2-b5dbf805f308 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:01.173624 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:01.174304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:01.174589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:01.174877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:01.177377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:01.190986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:01.192428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b2825-3df1-4e39-b8d3-41afdc8b8fd9 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:01.203440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1139/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:10.978148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=6 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:11.198575 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=31 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:21.115621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:21.116151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:21.116317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:21.117787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1127/2266] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:51:21.128124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:21.128571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:21.128711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:21.167045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] MFA Rules not processed for user `e33b3d4866d04b0095739952e76255c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:21.168282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:21.231612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1140/2267] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:51:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:21.242604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:21.244358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:21.262428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:21.264200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:21.265329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825aeeb-75c7-4c70-b947-202a625d359b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:21.272266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:21.272923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:21.273206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:21.273479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:21.280289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649bc37-82d8-4ce5-8f19-0eba74d79796 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:21.284001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:21.285089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:21.285577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:21.286063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:21.286352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:21.286623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] PATH_INFO: `/v3/users/6fb55e81e4c649b9b4df15a110af3f1c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:21.287900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fb55e81e4c649b9b4df15a110af3f1c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:21.289808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:21.306196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1128/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:21.499114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fb55e81e4c649b9b4df15a110af3f1c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:21.512338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fb55e81e4c649b9b4df15a110af3f1c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:21.559045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fb55e81e4c649b9b4df15a110af3f1c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:21.559662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fb55e81e4c649b9b4df15a110af3f1c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:21.566770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c689bd0d-b8ee-4cab-b58a-9d3ee27a864f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fb55e81e4c649b9b4df15a110af3f1c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:21.573320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1141/2269] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:51:21 2022] DELETE /identity/v3/users/6fb55e81e4c649b9b4df15a110af3f1c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:51:21.830571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:21.840593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866efd1-16af-4581-a2a1-c16566b15860 service placement] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:21.903134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:21.903988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:21.904273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:21.904577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] PATH_INFO: `/v3/projects/ad1fa6d6941e450489e617a06c16e511` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:21.905751 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1fa6d6941e450489e617a06c16e511)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:21.907680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.039315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1fa6d6941e450489e617a06c16e511', 'request_id': 'req-63bf946a-6b70-4819-9594-3f062e9dec5f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:22.045534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1fa6d6941e450489e617a06c16e511', 'request_id': 'req-63bf946a-6b70-4819-9594-3f062e9dec5f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:22.141703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1fa6d6941e450489e617a06c16e511', 'request_id': 'req-63bf946a-6b70-4819-9594-3f062e9dec5f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:22.153543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] The token cache is being invalidate because project ad1fa6d6941e450489e617a06c16e511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:51:22.153826 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:22.154471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63bf946a-6b70-4819-9594-3f062e9dec5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:22.156090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1129/2270] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:51:21 2022] DELETE /identity/v3/projects/ad1fa6d6941e450489e617a06c16e511 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:22.160949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.161391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.161505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.179601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:22.181430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.232882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:22.244719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1142/2271] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:22.252638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.252926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.253202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.271274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:22.272496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.280933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1130/2272] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:22.284974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.295311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91546da4-4571-4508-bb7c-d4099ce48d6d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.300060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.300719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.301299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.301573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.302331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:51:22.302638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.304282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.316084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1143/2273] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:51:22.320194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.329269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59d9ba-cb07-4ad5-bfc5-96c2cd938aa5 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.333844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.334507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.334787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.335059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.335753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.338183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.405972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1131/2274] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:51:22 2022] POST /identity/v3/projects => generated 389 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:51:22.409815 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.420305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ccb2-3bd6-4a61-b19b-ed2916b96f05 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.476478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.477142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.478024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.478330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.479029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.480931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.503346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.505052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.555098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:22.571136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1144/2275] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:51:22 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:51:22.574906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.579224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaaeef9-8f82-49c1-b6f0-56d06e91e7fc admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.584541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e7df49-b4cd-4eff-ab67-e0f293b70248 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.584827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.585475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.585759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.586083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.588349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.589744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.590447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.590814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.591086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.591845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.593562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.607226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1145/2276] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:51:22.608435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.618208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2cc409-2acb-4a72-b64b-0cbbcba2bd67 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.622959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.623586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.623872 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.624149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.624857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.626521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.638389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1146/2277] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:51:22.642278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.649274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.651438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f11ded-91b1-4494-8d33-5913949bc822 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.652457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a616a2-a71c-4d4c-8aff-8e4459c9a61d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.657272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.658107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.658392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.658674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] PATH_INFO: `/v3/projects/637ef2b9980c4dc799d75c608a6cf35e/users/82c03df8dd5c498ea670ab917c19c085/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.660813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1132/2278] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:51:22.674275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637ef2b9980c4dc799d75c608a6cf35e, user_id=82c03df8dd5c498ea670ab917c19c085, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.676997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.742718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1147/2279] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:51:22 2022] PUT /identity/v3/projects/637ef2b9980c4dc799d75c608a6cf35e/users/82c03df8dd5c498ea670ab917c19c085/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:22.753338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc213b6-29e6-4aab-b1da-f95c31184a23 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.753636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc213b6-29e6-4aab-b1da-f95c31184a23 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.753945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc213b6-29e6-4aab-b1da-f95c31184a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.781338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-abc213b6-29e6-4aab-b1da-f95c31184a23 None None] MFA Rules not processed for user `82c03df8dd5c498ea670ab917c19c085`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:22.782611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-abc213b6-29e6-4aab-b1da-f95c31184a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.847321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1133/2280] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:22.858414 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:22.860193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:22.938946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a9c4a-5429-46d4-9e5a-ed7e68d0e479 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:22.942572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:22.943214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:22.943504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:22.943782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:22.952206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:22.953626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:22.962437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1148/2281] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:29.014046 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:29.014542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:29.014697 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:29.039703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] MFA Rules not processed for user `0bd253c869e7428ca8765eeb8e8122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:29.039703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:29.098794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1134/2282] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:29.412032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:29.414015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:29.425508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:29.472813 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699cecc-5c98-48c7-8a5c-95a33c26b4c4 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:29.476660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:29.477407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:29.477767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:29.478063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:29.479837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:29.490283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:29.492377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:29.507882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1149/2283] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:29.881699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:29.884011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:29.906026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:29.957387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb450c-f741-4116-a7f2-b5672c9ea433 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:29.962293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:29.962934 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:29.963211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:29.963483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:29.965211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:29.976403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:29.978049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:29.987857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1135/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:32.669412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:32.670958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:32.682381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b1767-f723-41d0-99a0-262f8c101b99 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:32.686171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:32.686813 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:32.687096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:32.687375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:32.689271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:32.699185 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:32.700673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:32.708900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1150/2285] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:33.654086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:33.734927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3359d-1de4-41f0-95c0-146ec6b31110 service placement] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:33.740621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:33.741287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:33.741573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:33.741900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:33.743904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:33.756997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:33.759138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95396aea-57da-4371-bc3d-353f2dd9c657 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:33.776028 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1136/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:34.343804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:34.407855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498bc4d-15d5-4ce4-a915-5263ecb08db3 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:34.412402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:34.413264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:34.413548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:34.413822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] PATH_INFO: `/v3/users/82c03df8dd5c498ea670ab917c19c085` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:34.415083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c03df8dd5c498ea670ab917c19c085)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:34.417013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:34.578127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c03df8dd5c498ea670ab917c19c085'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:34.589949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c03df8dd5c498ea670ab917c19c085'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:34.684410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c03df8dd5c498ea670ab917c19c085'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:34.684980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c03df8dd5c498ea670ab917c19c085'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:34.692477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c03df8dd5c498ea670ab917c19c085'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:34.698643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1151/2287] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:51:34 2022] DELETE /identity/v3/users/82c03df8dd5c498ea670ab917c19c085 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:34.703246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:34.703717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:34.703815 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:34.720877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:34.722091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:34.779302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1137/2288] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:34.790649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:34.792063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:34.812596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:34.848215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991eb28a-b66f-44bc-8f27-fd17444eb5d7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:34.852447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:34.853159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:34.853441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:34.853717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:34.863682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:34.872572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348e364-4d96-4a0f-ac12-60039d66e4b1 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:34.875787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1152/2289] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:35.285699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.287151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:35.299159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952352e7-7126-4a11-a5ae-0481cc0809ee None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.303771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.304635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.305407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.305691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] PATH_INFO: `/v3/projects/637ef2b9980c4dc799d75c608a6cf35e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.306928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=637ef2b9980c4dc799d75c608a6cf35e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.308824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.415355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:35.428061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637ef2b9980c4dc799d75c608a6cf35e', 'request_id': 'req-755468a2-e1df-4d81-93e5-0599efacc0ab'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:35.434195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637ef2b9980c4dc799d75c608a6cf35e', 'request_id': 'req-755468a2-e1df-4d81-93e5-0599efacc0ab'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:35.484494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637ef2b9980c4dc799d75c608a6cf35e', 'request_id': 'req-755468a2-e1df-4d81-93e5-0599efacc0ab'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:35.497290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] The token cache is being invalidate because project 637ef2b9980c4dc799d75c608a6cf35e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:51:35.497578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:35.498260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-755468a2-e1df-4d81-93e5-0599efacc0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:51:35.499805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1138/2290] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:51:35 2022] DELETE /identity/v3/projects/637ef2b9980c4dc799d75c608a6cf35e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:35.505663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.506187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.506280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.525325 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:35.526639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:35.588701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1153/2291] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:35.596200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.596493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.596771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.615533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:35.616886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:35.626365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1139/2292] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:35.630632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.640505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123e835-cf80-4bd1-a26e-1aa3fb402b9d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.645062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.645710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.646021 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.646294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.647015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:51:35.647319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.649014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.660781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1154/2293] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:51:35.665539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.674773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de072aa6-02d7-4007-ae0e-aebbd236bd6f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.679394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.680664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.680948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.681247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.681971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.683856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.771086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1140/2294] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:51:35 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:51:35.775636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.785457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baa889-bd05-4d17-a791-39c16967d79f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.840131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.840785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.841065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.841339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.842053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.843946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.913221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1155/2295] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:51:35 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:51:35.917897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.928263 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9509930-b0b5-43b3-8331-f07da3f752d8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.933100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.933580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.933892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.934173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.934900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.936497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.946867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1141/2296] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:51:35.950549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.960344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04e5fc-9893-420c-993a-f9cc19b050e1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.965408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.966093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.966374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.966647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:35.967365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:35.968933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729c6b5-c141-4972-9275-9631a7a65eb2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:35.980654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1156/2297] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:51:35.983297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:35.993242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fd770-d610-495d-98aa-571c1a8e6105 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:35.997912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:35.998785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:35.999065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:35.999339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] PATH_INFO: `/v3/projects/b48edf25eb724491836a7a5cbf73d595/users/b440619aac564c94b798b53601d6567a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:36.014111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48edf25eb724491836a7a5cbf73d595, user_id=b440619aac564c94b798b53601d6567a, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:36.016749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:36.089791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1142/2298] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:51:35 2022] PUT /identity/v3/projects/b48edf25eb724491836a7a5cbf73d595/users/b440619aac564c94b798b53601d6567a/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:36.094929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39176-fbc8-4bb8-8397-d3146d8a5e84 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:36.095163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39176-fbc8-4bb8-8397-d3146d8a5e84 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:36.095437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d39176-fbc8-4bb8-8397-d3146d8a5e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:36.113819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-88d39176-fbc8-4bb8-8397-d3146d8a5e84 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:36.115052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-88d39176-fbc8-4bb8-8397-d3146d8a5e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:36.135355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:36.172732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1157/2299] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:36.183594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:36.189924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:36.241628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ffc9a2-bd38-48ad-9e00-0df5527584bb admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:36.245226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:36.246163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:36.246447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:36.246720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:36.255594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:36.257009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:36.267047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1143/2300] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:41.703862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:41.704381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:41.704381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:41.734918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] MFA Rules not processed for user `b440619aac564c94b798b53601d6567a`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:41.736205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:41.809593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1158/2301] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:41.814331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:41.824496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7b494-3541-4ba2-af75-2c3816128958 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:41.829473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:41.830279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:41.830635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:41.831000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:41.831786 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:41.837952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:41.915435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1144/2302] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:51:41 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:51:41.919687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:41.930470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d92c-890f-457b-acb2-de1ee7649d72 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:41.985425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:41.986128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:41.986417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:41.986686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:41.987389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:41.989310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:42.069496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1159/2303] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:51:41 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:51:42.071410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:42.081866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bedc1-60c8-4594-92b8-25ecb620d205 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:42.087427 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:42.088092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:42.088374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:42.088651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:42.089474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:42.091152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:42.103052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1145/2304] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:51:42.107376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:42.117553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816396cc-b586-4c0e-abb1-f7d4238f6181 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:42.122278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:42.123163 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:42.123448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:42.123727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] PATH_INFO: `/v3/projects/54b8b055a7d3481ba987db689ccaf433/users/919408418ef546e48a27a8c1e2534cb3/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:42.139196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b8b055a7d3481ba987db689ccaf433, user_id=919408418ef546e48a27a8c1e2534cb3, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:42.141833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:42.209586 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1160/2305] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:51:42 2022] PUT /identity/v3/projects/54b8b055a7d3481ba987db689ccaf433/users/919408418ef546e48a27a8c1e2534cb3/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:42.214208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:42.224099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b81fb0-b8ad-444b-acb1-8f3fc2011779 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:42.243327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:42.280354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:42.281033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:42.281349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:42.281626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:42.282400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:42.284081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:42.298419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1146/2306] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:51:42.299432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:42.310403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eda94-8224-4758-b338-3ea946653d6b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:42.315096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:42.315986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:42.316272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:42.316545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] PATH_INFO: `/v3/projects/54b8b055a7d3481ba987db689ccaf433/users/919408418ef546e48a27a8c1e2534cb3/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:42.318772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b8b055a7d3481ba987db689ccaf433, user_id=919408418ef546e48a27a8c1e2534cb3, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:42.321883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd72848-7894-458a-bc82-fa7966204478 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:42.333131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1161/2307] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:51:42 2022] PUT /identity/v3/projects/54b8b055a7d3481ba987db689ccaf433/users/919408418ef546e48a27a8c1e2534cb3/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:51:45.159769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:45.166043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:45.405670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb31726-2bf7-4b44-b1cc-0df9aa9839a0 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:45.530478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:45.531172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:45.531462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:45.531737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:45.542026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:45.699412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:45.705012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:45.706725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:45.744105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1147/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:48.501294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643d05-e9d2-4007-bd2d-0f0d144c5537 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:48.501794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643d05-e9d2-4007-bd2d-0f0d144c5537 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:48.502169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643d05-e9d2-4007-bd2d-0f0d144c5537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:48.532714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:48.548883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-54643d05-e9d2-4007-bd2d-0f0d144c5537 None None] MFA Rules not processed for user `919408418ef546e48a27a8c1e2534cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:48.550808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-54643d05-e9d2-4007-bd2d-0f0d144c5537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:48.646004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1162/2309] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:48.658889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:48.660683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:48.769122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ea214-96a9-4b55-a1a2-482a1fd56e54 service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:48.774029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:48.774715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:48.775001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:48.775279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:48.843881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:48.845250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:48.857214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1148/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:49.115036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12488f-3e50-410f-96f8-87fec2a540a8 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:49.115334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12488f-3e50-410f-96f8-87fec2a540a8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:49.115615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12488f-3e50-410f-96f8-87fec2a540a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:49.139544 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6b12488f-3e50-410f-96f8-87fec2a540a8 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:49.141082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6b12488f-3e50-410f-96f8-87fec2a540a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:49.230976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1163/2311] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:51:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:49.379950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:49.381488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:49.455247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d29f58-b709-4542-91cc-fabbeeb24640 service glance] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:49.461795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:49.462526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:49.462807 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:49.463080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:49.472178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:49.473773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:49.483416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1149/2312] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:51:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:51:57.819085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:57.820469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:57.820891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:57.841460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] MFA Rules not processed for user `f0d12edb8e754ddb9578226105d4fa6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:51:57.842794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:57.850127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1164/2313] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:51:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:51:58.199925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:58.203355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:58.256286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:58.274892 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10d9c7-b500-4742-b7d5-ef7a5c762023 service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:58.279216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:58.279941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:58.280319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:58.281964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:58.283787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:58.298100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:58.299560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e3ff47-143c-48a0-bd4d-7fb47b0625b0 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:51:58.310831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1150/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:51:59.797327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:51:59.802302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:59.891508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739c26c-9306-44df-bf00-e619f330b7d0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:51:59.899147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:51:59.899860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:51:59.900143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:51:59.900450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:51:59.903581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:51:59.970200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:51:59.987959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:51:59.989674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f078412-4f52-4efd-add5-7a94ce3e21bb service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:00.005393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1165/2315] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:51:59 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:00.782991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:00.783526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:00.783526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:00.801672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] MFA Rules not processed for user `b440619aac564c94b798b53601d6567a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:00.802897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:00.809919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1151/2316] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:07.942835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:07.943254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:07.943394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:07.978959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:07.980118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:07.987936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1166/2317] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:52:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:08.001610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:08.017584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d2e0a-9cd4-4ab9-9c5d-d80238296f8e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:08.023103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:08.023942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:08.024229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:08.025221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:08.036480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:08.038061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:08.048184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1152/2318] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:52:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:52:08.681263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:08.683755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:08.723253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c36cc6-d1ec-4ab6-8d3f-156b6cc4f18e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:08.730338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:08.731011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:08.731303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:08.731584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:08.733450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:08.747601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:08.749355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:08.762131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1167/2319] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:14.744728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:14.758051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063c71a-6341-46a6-81d8-6ffd883ac767 service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:14.763575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:14.764215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:14.764500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:14.764776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:14.766592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:14.779157 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:14.780718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae174cb-591d-465c-9c29-69c7236c4d3e service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:14.795392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1153/2320] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:18.756303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=15 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:20.879537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:20.884237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:20.892838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba665a7d-97a9-48e7-9a01-ac4dd5b2a64f service nova] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:20.896498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:20.897124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:20.897920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:20.898198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:20.900123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:20.957628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:20.959084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:20.968377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1168/2321] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:24.788506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=23 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:30.971025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=28 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:32.720174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:32.721423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:32.721423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:32.738425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] MFA Rules not processed for user `715bb36a29d743e1b8b0fbad427efcd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:32.739612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:32.746450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1154/2322] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:42.187662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:42.196890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545813b3-3f08-4d28-8dd2-7b9f3b53ef0b service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:42.200450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:42.201085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:42.201371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:42.201655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:42.211004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:42.212364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:42.222696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1169/2323] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:42.733720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:44.515266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:44.526708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe26ffc-31a8-461b-aadc-8a9750fb4f2a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:44.530594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:44.531301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:44.535763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:44.535763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:44.535763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:44.629083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:44.633596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:44.644398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1155/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:49.026408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:49.026408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:49.044737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21c212-06d1-40c2-ba02-ea147eef0cb9 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:49.050808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:49.051932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:49.052155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:49.052571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] PATH_INFO: `/v3/users/9bd6f3beda094f9c9bd43862a296b30a` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:49.054913 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd6f3beda094f9c9bd43862a296b30a)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:49.057017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:49.232820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd6f3beda094f9c9bd43862a296b30a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.253665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd6f3beda094f9c9bd43862a296b30a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.359771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd6f3beda094f9c9bd43862a296b30a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.362760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd6f3beda094f9c9bd43862a296b30a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.384383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e8b004c0-a96e-4012-8ed5-0995ed8b09a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd6f3beda094f9c9bd43862a296b30a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.402062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1170/2325] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:52:49 2022] DELETE /identity/v3/users/9bd6f3beda094f9c9bd43862a296b30a => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:52:49.776522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:49.795039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cddc7-fdf6-4732-87ff-e1d0c277956d service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:49.846485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:49.847338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:49.847619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:49.847891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] PATH_INFO: `/v3/projects/eadb7cd25b7544d883f125016f71b37c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:49.849084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eadb7cd25b7544d883f125016f71b37c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:49.851529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:49.957519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eadb7cd25b7544d883f125016f71b37c', 'request_id': 'req-c0ac21ac-bcb6-4a1c-970d-a762133855b1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:49.963533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eadb7cd25b7544d883f125016f71b37c', 'request_id': 'req-c0ac21ac-bcb6-4a1c-970d-a762133855b1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:50.043107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eadb7cd25b7544d883f125016f71b37c', 'request_id': 'req-c0ac21ac-bcb6-4a1c-970d-a762133855b1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:50.054555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] The token cache is being invalidate because project eadb7cd25b7544d883f125016f71b37c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:52:50.054848 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:50.055481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c0ac21ac-bcb6-4a1c-970d-a762133855b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:52:50.057103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1156/2326] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:52:49 2022] DELETE /identity/v3/projects/eadb7cd25b7544d883f125016f71b37c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:52:50.067403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.067888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.067982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.086120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:50.087319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:50.147588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1171/2327] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:50.155230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.155520 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.155796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.174422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:50.175632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:50.183998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1157/2328] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:50.187930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.198193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b3433-c99c-4a52-8a77-f13965d95663 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.202771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.203420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.203706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.203986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.204745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:52:50.205056 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.206697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.218050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1172/2329] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:52:50.222041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.231194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c9c8-65e5-4930-9386-986f83aa42c1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.235859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.236497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.236784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.237059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.237754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.239681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.254687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:50.353152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1158/2330] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:52:50.356821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.367542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d090a2f-06db-4c4d-9444-fa5eddeef244 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.411083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:50.424294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.424958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.425242 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.425520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.426247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.428799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.529293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1173/2331] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:52:50.533090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.546843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8eaeb-5840-4d9d-bf9c-a5598676b1d6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.551866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.555093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.555093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.555093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.555093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.555472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.565714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1159/2332] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:52:50.570341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.580585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8efc9-e4d5-4345-ba73-49cfc3bac915 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.586151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.586830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.587111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.587387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.588142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.590055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64733e5a-c523-472c-b4a2-5461b91d0ac7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.600530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1174/2333] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:52:50.605121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.615289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f868f6a0-9cca-4982-a25e-665fc649f028 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.620385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.621299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.621583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.621924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] PATH_INFO: `/v3/projects/55ed9afdcb11480db80e1428a49cbda8/users/76ad4bb9e9b94b5ca3a10ff10003c165/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.637997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ed9afdcb11480db80e1428a49cbda8, user_id=76ad4bb9e9b94b5ca3a10ff10003c165, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.640638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:50.729078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1160/2334] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:52:50 2022] PUT /identity/v3/projects/55ed9afdcb11480db80e1428a49cbda8/users/76ad4bb9e9b94b5ca3a10ff10003c165/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:52:50.739440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.739729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.740003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.774711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] MFA Rules not processed for user `76ad4bb9e9b94b5ca3a10ff10003c165`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:50.776024 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:50.845052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1175/2335] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:52:50.849615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:50.912967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08d15a-be7c-4f18-bad9-109666e09336 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:50.918308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:50.918972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:50.919261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:50.919542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:50.920249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:50.922256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.046299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1161/2336] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:52:50 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:52:51.050004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.060681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0c30a-c5de-4433-b76d-bf3049a44bed None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.118900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.119747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.120039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.120311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.120996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.122956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.404428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1176/2337] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:52:51 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:52:51.408282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.418504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca4120-d053-45b0-81a0-4bb66736fb27 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.423291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.423958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.424244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.424522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.425314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.427111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.440677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1162/2338] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:52:51.445649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.456037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca9781-0f8a-452d-9bda-68cf04617ec9 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.461486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.462438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.462724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.463000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] PATH_INFO: `/v3/projects/023ba7ff638f49d3af251cc1c77a9308/users/695378a01a124536a678821964413112/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.478131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ba7ff638f49d3af251cc1c77a9308, user_id=695378a01a124536a678821964413112, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.480786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.547118 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1177/2339] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:52:51 2022] PUT /identity/v3/projects/023ba7ff638f49d3af251cc1c77a9308/users/695378a01a124536a678821964413112/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:52:51.551074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.561408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f6950d-f9ee-4ff2-bd95-42d4f095a694 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.618573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.619245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.619528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.619803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.620561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.622226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb1dbe-2958-4f10-984d-f3c84a304572 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.633043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1163/2340] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:52:51.637176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.647665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51378e4c-c7a3-45ac-af66-2700b302eae6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.652304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.653277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.653559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.653832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] PATH_INFO: `/v3/projects/023ba7ff638f49d3af251cc1c77a9308/users/695378a01a124536a678821964413112/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.655956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ba7ff638f49d3af251cc1c77a9308, user_id=695378a01a124536a678821964413112, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.658674 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.669361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1178/2341] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:52:51 2022] PUT /identity/v3/projects/023ba7ff638f49d3af251cc1c77a9308/users/695378a01a124536a678821964413112/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:52:51.681609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.681917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.682195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.710597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] MFA Rules not processed for user `695378a01a124536a678821964413112`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:52:51.711828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:51.720894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:51.780295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1164/2342] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:52:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:52:51.791256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:51.796886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:52:51.802748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:52:51.857296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9c6f3-88d4-42a8-8b8f-32c3f145d185 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:51.861548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:51.862333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:51.862688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:51.863036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:51.873864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:51.875613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d45e14-731d-4140-8bff-cadd73b1e760 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:51.888673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1179/2343] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:51 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:52:52.104182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:52:52.116873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e67d9-fb9d-48fd-b547-9bb876e40286 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:52:52.120516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:52:52.121164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:52:52.121454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:52:52.121825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:52:52.197692 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:52:52.199340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:52:52.214032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1165/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:52:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:01.935823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=23 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:02.205518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=52 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:17.136625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57167fb-219d-4d40-b6c2-1ac81c7ba111 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:17.136625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57167fb-219d-4d40-b6c2-1ac81c7ba111 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:17.136625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57167fb-219d-4d40-b6c2-1ac81c7ba111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:17.153614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d57167fb-219d-4d40-b6c2-1ac81c7ba111 None None] MFA Rules not processed for user `0bd253c869e7428ca8765eeb8e8122f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:17.155003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d57167fb-219d-4d40-b6c2-1ac81c7ba111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:17.209524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1180/2345] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:27.202836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=25 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:28.855178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:28.917059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d6ae5-bd5f-4d67-b1d2-99d9bfc63f98 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:28.921782 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:28.922864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:28.922986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:28.923219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] PATH_INFO: `/v3/users/76ad4bb9e9b94b5ca3a10ff10003c165` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:28.925748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ad4bb9e9b94b5ca3a10ff10003c165)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:28.928262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:29.072945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ad4bb9e9b94b5ca3a10ff10003c165'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.084816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ad4bb9e9b94b5ca3a10ff10003c165'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.091764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ad4bb9e9b94b5ca3a10ff10003c165'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.094748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ad4bb9e9b94b5ca3a10ff10003c165'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.094748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ad4bb9e9b94b5ca3a10ff10003c165'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.144966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1166/2346] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:28 2022] DELETE /identity/v3/users/76ad4bb9e9b94b5ca3a10ff10003c165 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:29.149633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:29.150137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:29.150249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:29.167715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:29.168927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:29.227062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1181/2347] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:29.236569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:29.238100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:29.295769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a11c6-3c2c-4948-8b31-f005e551df12 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:29.299433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:29.300073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:29.300357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:29.300634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:29.309608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:29.311066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:29.320914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1167/2348] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:29.735635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:29.737147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:29.750737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbae69f-f501-4837-8caf-4040aeab1058 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:29.755620 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:29.758950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:29.758950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:29.758950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] PATH_INFO: `/v3/projects/55ed9afdcb11480db80e1428a49cbda8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:29.758950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ed9afdcb11480db80e1428a49cbda8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:29.761224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:29.859336 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ed9afdcb11480db80e1428a49cbda8', 'request_id': 'req-10d27eee-6a42-416e-bba2-5232d2844e54'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.865557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ed9afdcb11480db80e1428a49cbda8', 'request_id': 'req-10d27eee-6a42-416e-bba2-5232d2844e54'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.961326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ed9afdcb11480db80e1428a49cbda8', 'request_id': 'req-10d27eee-6a42-416e-bba2-5232d2844e54'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.972233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] The token cache is being invalidate because project 55ed9afdcb11480db80e1428a49cbda8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:29.974871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.974871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:29.975724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1182/2349] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:29 2022] DELETE /identity/v3/projects/55ed9afdcb11480db80e1428a49cbda8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:29.979812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:29.990388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316f00-18e5-4396-b891-2805a0466f47 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:30.009609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:30.046874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:30.047749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:30.048034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:30.048308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] PATH_INFO: `/v3/users/695378a01a124536a678821964413112` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:30.049534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] RBAC: Authorizing `identity:delete_user(user_id=695378a01a124536a678821964413112)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:30.051484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:30.192048 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695378a01a124536a678821964413112'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.203535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695378a01a124536a678821964413112'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.210422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695378a01a124536a678821964413112'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.211083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695378a01a124536a678821964413112'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.211687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1cd4df3f-97f1-424c-a7bd-736802f3a18b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695378a01a124536a678821964413112'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.276130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1168/2350] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:29 2022] DELETE /identity/v3/users/695378a01a124536a678821964413112 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:30.683669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:30.685704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:30.699703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d27eee-6a42-416e-bba2-5232d2844e54 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:30.763619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:30.764491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:30.764772 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:30.765049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] PATH_INFO: `/v3/projects/023ba7ff638f49d3af251cc1c77a9308` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:30.766287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ba7ff638f49d3af251cc1c77a9308)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:30.768410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:30.867900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:30.884007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ba7ff638f49d3af251cc1c77a9308', 'request_id': 'req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.890288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ba7ff638f49d3af251cc1c77a9308', 'request_id': 'req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.956897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ba7ff638f49d3af251cc1c77a9308', 'request_id': 'req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.968762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] The token cache is being invalidate because project 023ba7ff638f49d3af251cc1c77a9308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:30.968874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.969546 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-dae1bf5a-9552-49e9-a7a4-9e0fefdd23e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:30.971171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1183/2351] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:30 2022] DELETE /identity/v3/projects/023ba7ff638f49d3af251cc1c77a9308 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:30.976828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:30.977141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:30.977440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.001549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:31.002812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:31.070784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1169/2352] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:31.078345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.078637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.078916 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.096947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:31.098177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:31.107455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1184/2353] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:31.111533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.121350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75aefda-fa76-4f2c-9808-ce131cb37b41 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.125965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.126621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.126902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.127179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.127898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:53:31.128205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.129792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.142454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1170/2354] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:53:31.147362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.157188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925a20-e281-4381-9d12-437a3f6557ac None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.162335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.162984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.163265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.163666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.164373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.166295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.262377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1185/2355] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:31.266278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.276883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a4471-dda4-497a-87f6-72e401813155 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.304216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:31.335283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.335968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.336412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.336744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.337399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.339355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.437202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1171/2356] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:53:31.441244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.451595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be57973-ccf5-4fbf-9fb0-2ca2f5660b38 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.456210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.456857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.457143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.457424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.458193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.460303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.470685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1186/2357] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:31.475167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.484998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530108f0-9cae-46ed-93e8-71e4dd531b31 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.489627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.490285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.490568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.490840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.491552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.493194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2c3e65-ea25-4101-8887-739ba4f7e87b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.503030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1172/2358] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:31.507028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.517129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008ae09-8472-460f-8144-c5c2aa890373 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.522404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.523278 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.523562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.523839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] PATH_INFO: `/v3/projects/79c7540ea54e4ef081117863d63708cd/users/c61d3d2146444b309eefb29795f51670/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.539201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c7540ea54e4ef081117863d63708cd, user_id=c61d3d2146444b309eefb29795f51670, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.541844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.654824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1187/2359] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:31 2022] PUT /identity/v3/projects/79c7540ea54e4ef081117863d63708cd/users/c61d3d2146444b309eefb29795f51670/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:31.666158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.666453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.666729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.693932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] MFA Rules not processed for user `c61d3d2146444b309eefb29795f51670`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:31.694849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:31.767730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1173/2360] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:31.772853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.836733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469253a-51a8-4161-9a8f-bee7a8386877 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:31.841466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:31.842159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:31.842445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:31.842728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:31.843430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:31.845335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:31.956443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1188/2361] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/projects => generated 365 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:53:31.957499 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:31.969638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6351f-3914-4214-9171-4920409cd0d0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.033522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.034272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.034504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.034781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.035496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.038134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.137690 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1174/2362] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:31 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:53:32.139114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.150110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4cb756-9879-4059-929d-1b9881659d48 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.156005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.156676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.157475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.157475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.157968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.159670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.175471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1189/2363] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:32.176627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.187944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc46ea1-4a6a-461b-a0db-9b6a85902dd1 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.196675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.197573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.197884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.198187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] PATH_INFO: `/v3/projects/9985b97ae26a48d689fa5bfa7faea253/users/1935733345534e8292350c955a8c1c8f/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.215252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9985b97ae26a48d689fa5bfa7faea253, user_id=1935733345534e8292350c955a8c1c8f, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.217991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.285121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1175/2364] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:32 2022] PUT /identity/v3/projects/9985b97ae26a48d689fa5bfa7faea253/users/1935733345534e8292350c955a8c1c8f/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:53:32.289633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.301028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f731a-8dcb-4bbe-9eed-75e4ab8cfd71 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.323629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:32.367135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.367930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.368286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.368643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.369990 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.371358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa72ecf-14d7-47b4-a1dc-d873aea2df82 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.384491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1190/2365] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:32.388594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.397018 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:32.404396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a6a49-ef0b-4c27-80b6-a939a103a498 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.410220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.411670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.411957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.412235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] PATH_INFO: `/v3/projects/9985b97ae26a48d689fa5bfa7faea253/users/1935733345534e8292350c955a8c1c8f/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.414295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9985b97ae26a48d689fa5bfa7faea253, user_id=1935733345534e8292350c955a8c1c8f, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.417055 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.429800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1176/2366] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:32 2022] PUT /identity/v3/projects/9985b97ae26a48d689fa5bfa7faea253/users/1935733345534e8292350c955a8c1c8f/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:53:32.439710 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62184ce9-c2b2-4783-868c-644951846282 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.440009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62184ce9-c2b2-4783-868c-644951846282 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.440486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62184ce9-c2b2-4783-868c-644951846282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.475866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-62184ce9-c2b2-4783-868c-644951846282 None None] MFA Rules not processed for user `1935733345534e8292350c955a8c1c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:32.477075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-62184ce9-c2b2-4783-868c-644951846282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:32.561057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1191/2367] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:32.569083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.571834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:32.637702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca286b-7118-4e29-86a7-5211cc2db148 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.641663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.642415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.642704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.642982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.653961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.655400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.667421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1177/2368] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:32.862711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62184ce9-c2b2-4783-868c-644951846282 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:32.872596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62184ce9-c2b2-4783-868c-644951846282 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:32.876527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:32.877172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:32.877459 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:32.877733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:32.938844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:32.940293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91834124-7ee8-4754-8e13-5c2a5f2a589a service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:32.950807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1192/2369] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:36.428090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:36.487978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adc94e3-9cd8-4c43-a480-c6c39a05efce service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:36.492999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:36.493888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:36.494156 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:36.494425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] PATH_INFO: `/v3/users/c61d3d2146444b309eefb29795f51670` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:36.495599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61d3d2146444b309eefb29795f51670)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:36.497509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:36.644256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61d3d2146444b309eefb29795f51670'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:36.655731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61d3d2146444b309eefb29795f51670'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:36.662422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61d3d2146444b309eefb29795f51670'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:36.663074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61d3d2146444b309eefb29795f51670'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:36.663714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61d3d2146444b309eefb29795f51670'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:36.785274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1178/2370] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:36 2022] DELETE /identity/v3/users/c61d3d2146444b309eefb29795f51670 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:36.789767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:36.790247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:36.790384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:36.807909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:36.809135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:36.849327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:36.868212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1193/2371] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:36.877836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:36.879285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:36.893134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:36.936935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb3941-ee48-4e5f-be70-9fd895a497d0 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:36.941119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:36.941759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:36.942095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:36.942374 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:36.951932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:36.953356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:36.963524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1179/2372] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:37.346808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:37.348374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:37.365594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97166-a259-417c-8d0e-708dfbe32f09 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:37.370404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:37.371515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:37.371912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:37.372307 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] PATH_INFO: `/v3/projects/79c7540ea54e4ef081117863d63708cd` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:37.373771 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c7540ea54e4ef081117863d63708cd)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:37.375922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:37.476342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c7540ea54e4ef081117863d63708cd', 'request_id': 'req-1c1e3c33-52c8-457d-ac95-a210aece6c99'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.482660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c7540ea54e4ef081117863d63708cd', 'request_id': 'req-1c1e3c33-52c8-457d-ac95-a210aece6c99'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.539541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c7540ea54e4ef081117863d63708cd', 'request_id': 'req-1c1e3c33-52c8-457d-ac95-a210aece6c99'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.550522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] The token cache is being invalidate because project 79c7540ea54e4ef081117863d63708cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:37.550807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.551473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.553666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1194/2373] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:37 2022] DELETE /identity/v3/projects/79c7540ea54e4ef081117863d63708cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:37.557654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:37.567373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03898730-032d-40e7-891d-944f6cadcf23 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:37.624183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:37.624983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:37.625265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:37.625549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] PATH_INFO: `/v3/users/1935733345534e8292350c955a8c1c8f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:37.626747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1935733345534e8292350c955a8c1c8f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:37.628656 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:37.791763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1935733345534e8292350c955a8c1c8f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.804023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1935733345534e8292350c955a8c1c8f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.810816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1935733345534e8292350c955a8c1c8f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.811475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1935733345534e8292350c955a8c1c8f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.812121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-71e8e0e2-397e-42a6-a576-a139acdc29c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1935733345534e8292350c955a8c1c8f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:37.899434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1180/2374] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:37 2022] DELETE /identity/v3/users/1935733345534e8292350c955a8c1c8f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:38.331889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:38.331889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:38.347284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e3c33-52c8-457d-ac95-a210aece6c99 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:38.407391 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:38.408250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.408534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.408812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] PATH_INFO: `/v3/projects/9985b97ae26a48d689fa5bfa7faea253` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.410059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9985b97ae26a48d689fa5bfa7faea253)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:38.411970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:38.533959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9985b97ae26a48d689fa5bfa7faea253', 'request_id': 'req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:38.541103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9985b97ae26a48d689fa5bfa7faea253', 'request_id': 'req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:38.601124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9985b97ae26a48d689fa5bfa7faea253', 'request_id': 'req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:38.607753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:38.612345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] The token cache is being invalidate because project 9985b97ae26a48d689fa5bfa7faea253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:38.612631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:38.613299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-28ac5c23-2a3e-48c9-a303-06e7b92d6cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:38.614973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1195/2375] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:38 2022] DELETE /identity/v3/projects/9985b97ae26a48d689fa5bfa7faea253 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:53:38.620716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.621176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.621367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.640064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:38.644753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:38.670310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:38.701255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1181/2376] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:38.709320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.709642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.710013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.728086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:38.729288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:38.737197 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1196/2377] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:53:38.741951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:38.751483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ac663-1ada-4f7d-b7af-f7256f35bdea None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:38.756795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:38.757585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.758581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.758867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.759592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:53:38.759898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:38.761479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:38.772827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1182/2378] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:53:38.776943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:38.786298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90b6fa2-ad77-4d21-be0a-fca3053bdd73 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:38.790938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:38.791582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.791871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.792153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.792886 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:38.794869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:38.867046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1197/2379] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:38 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:53:38.870923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:38.881495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d91f8-e506-4b9b-a2cd-b3298f08e2d3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:38.936579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:38.937249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:38.937526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:38.937800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:38.941739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:38.941739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.009227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1183/2380] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:38 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:39.013456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.023947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846f549-6ef9-434c-9b68-17bffd796884 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.028628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.029273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.029552 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.029826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.030773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.032361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.043078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1198/2381] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:39.046722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.057119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab366d-bbc8-4744-8e1b-244836e6de09 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.061758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.062452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.062740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.063017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.063738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.065321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847307-ada6-4018-8130-78a4638a8647 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.075749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1184/2382] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:39.079555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.089159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7128dc-c813-4382-967f-c3ee2ec3f959 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.093694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.094609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.094889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.095161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] PATH_INFO: `/v3/projects/d84396729aee4998b3a7b2071f1ade02/users/989e00d2591e4e1e96fc47d0fd81f02e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.109655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84396729aee4998b3a7b2071f1ade02, user_id=989e00d2591e4e1e96fc47d0fd81f02e, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.112322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.172876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1199/2383] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:39 2022] PUT /identity/v3/projects/d84396729aee4998b3a7b2071f1ade02/users/989e00d2591e4e1e96fc47d0fd81f02e/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:39.184702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.184997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.185277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.211618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] MFA Rules not processed for user `989e00d2591e4e1e96fc47d0fd81f02e`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:39.212819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:39.275714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1185/2384] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:53:39.280126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.340265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd72490-365c-4481-958c-8b3316eb84d3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.345046 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.345685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.345996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.346271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.346950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.349404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.437581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1200/2385] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:39 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:39.441393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.452413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902b0ee-8cc0-4c08-b3b0-7c46fbd32e7c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.479329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:39.509322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.510016 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.510301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.510576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.511256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.513172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.574337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1186/2386] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:39 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:39.578232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.589280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeb282-2a6d-48b3-8ed6-4214165d6283 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.594037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.594665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.594952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.595232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.595978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.597550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.609621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1201/2387] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:39.613478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.623604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fc77-1ca9-495a-96ed-0620aa6ade5e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.628279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.628927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.629213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.629491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.630250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.631829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72604e-2bbd-4364-86cc-ec0ed2eb0540 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.641981 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1187/2388] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:39.646404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.656196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e9233-f14d-4d50-afa3-6aa1a06cedef admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.660948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.662520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.662800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.663072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] PATH_INFO: `/v3/projects/1200fc94bb4b4f058c7354d2afecb5dc/users/ca821cfe1ef74dc18a5b2f5b78d0b9c0/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.677976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1200fc94bb4b4f058c7354d2afecb5dc, user_id=ca821cfe1ef74dc18a5b2f5b78d0b9c0, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.680672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:39.808052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1202/2389] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:39 2022] PUT /identity/v3/projects/1200fc94bb4b4f058c7354d2afecb5dc/users/ca821cfe1ef74dc18a5b2f5b78d0b9c0/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:39.818647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.818939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.824123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.847076 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] MFA Rules not processed for user `ca821cfe1ef74dc18a5b2f5b78d0b9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:39.848229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:39.911139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1188/2390] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:39.915692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:39.960797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:39.976417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20289db0-a3c1-4284-8011-ada1b1bf4f9d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:39.981252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:39.981958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:39.982241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:39.982516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:39.983208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:39.985151 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.053699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1203/2391] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:39 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:53:40.057647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.068774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c63ce3-50fc-447b-b8bc-cf2d2e5ff00b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.123841 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.124440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.124724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.125001 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.125729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.127688 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.202163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1189/2392] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:40 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:40.206095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.216440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623297cb-f78b-46ad-805c-8d6e94380724 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.221157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.221811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.222133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.222410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.223130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.224740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.235303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1204/2393] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:40.239093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.249397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cb880-ed62-4a42-ab2a-4a5f6bc3ed64 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.254137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.255045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.255882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.256155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] PATH_INFO: `/v3/projects/362297cbd55a4210a993d5ede5320bef/users/fa3203878c6845228b7348ffaa172fac/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.270618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=362297cbd55a4210a993d5ede5320bef, user_id=fa3203878c6845228b7348ffaa172fac, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.273232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.368408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1190/2394] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:40 2022] PUT /identity/v3/projects/362297cbd55a4210a993d5ede5320bef/users/fa3203878c6845228b7348ffaa172fac/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:40.372370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.383235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b371b3-48b7-4f71-aae2-3f512e7243e4 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.439961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.440626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.440917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.441195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.441943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.444183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cff00-695c-4a64-aa12-a5828c307af9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.454159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1205/2395] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:53:40.458197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.463746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:40.468906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913504b2-cd62-42f3-9e18-754f7e140c1e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.473491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.474409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.474693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.474968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] PATH_INFO: `/v3/projects/362297cbd55a4210a993d5ede5320bef/users/fa3203878c6845228b7348ffaa172fac/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.476914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=362297cbd55a4210a993d5ede5320bef, user_id=fa3203878c6845228b7348ffaa172fac, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.479547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.490006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1191/2396] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:40 2022] PUT /identity/v3/projects/362297cbd55a4210a993d5ede5320bef/users/fa3203878c6845228b7348ffaa172fac/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:40.501169 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.501455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.501760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.528683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] MFA Rules not processed for user `fa3203878c6845228b7348ffaa172fac`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:40.529914 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:40.600165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1206/2397] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:40.611311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.613004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:40.672706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09319119-b23b-41c1-93c0-71b5272822c2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.676418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.677686 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.678033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.678313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.687385 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.688805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.698343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1192/2398] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:40.851033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:40.852469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:40.864375 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7a706-63f3-486e-8596-6f01028fcd54 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:40.868614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:40.869298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:40.869584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:40.869882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:40.907856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:40.926240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:40.928184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2ebc-bf9d-4009-91bd-5cbd7c5b7b9c service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:40.937218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1207/2399] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:53:44.816419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:44.878678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5cc87c-2714-4007-a4b5-d19f46dfddde service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:44.884776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:44.885645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:44.885969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:44.886250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] PATH_INFO: `/v3/users/989e00d2591e4e1e96fc47d0fd81f02e` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:44.887522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=989e00d2591e4e1e96fc47d0fd81f02e)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:44.889637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:45.078279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989e00d2591e4e1e96fc47d0fd81f02e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.090203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989e00d2591e4e1e96fc47d0fd81f02e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.097035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989e00d2591e4e1e96fc47d0fd81f02e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.097700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989e00d2591e4e1e96fc47d0fd81f02e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.098412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989e00d2591e4e1e96fc47d0fd81f02e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.166874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1193/2400] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:44 2022] DELETE /identity/v3/users/989e00d2591e4e1e96fc47d0fd81f02e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:53:45.171303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:45.171829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:45.171937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:45.189685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:45.190979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:45.248877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1208/2401] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:45.258676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:45.260097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:45.273476 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:45.316985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ebfe32-d27f-497f-b69c-8b63b68c12ee admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:45.320635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:45.321301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:45.321585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:45.321885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:45.330901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:45.332262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:45.342493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1194/2402] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:45.798081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:45.799593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:45.812975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9801bf-a325-4a12-a080-e837d8b66fb7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:45.817693 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:45.822193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:45.822193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:45.822193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] PATH_INFO: `/v3/projects/d84396729aee4998b3a7b2071f1ade02` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:45.822193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84396729aee4998b3a7b2071f1ade02)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:45.822928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:45.985543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84396729aee4998b3a7b2071f1ade02', 'request_id': 'req-ffc0d0b5-750b-46d4-a374-2d124f529836'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:45.991821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84396729aee4998b3a7b2071f1ade02', 'request_id': 'req-ffc0d0b5-750b-46d4-a374-2d124f529836'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.065213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84396729aee4998b3a7b2071f1ade02', 'request_id': 'req-ffc0d0b5-750b-46d4-a374-2d124f529836'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.076901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] The token cache is being invalidate because project d84396729aee4998b3a7b2071f1ade02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:46.077206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.077829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.079409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1209/2403] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:45 2022] DELETE /identity/v3/projects/d84396729aee4998b3a7b2071f1ade02 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:53:46.083349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:46.093635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48b375-ae08-4398-85cb-2e34a04887e3 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:46.149368 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:46.150279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:46.150563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:46.150840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] PATH_INFO: `/v3/users/ca821cfe1ef74dc18a5b2f5b78d0b9c0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:46.152015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca821cfe1ef74dc18a5b2f5b78d0b9c0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:46.153943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:46.340498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca821cfe1ef74dc18a5b2f5b78d0b9c0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.352272 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca821cfe1ef74dc18a5b2f5b78d0b9c0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.359081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca821cfe1ef74dc18a5b2f5b78d0b9c0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.359740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca821cfe1ef74dc18a5b2f5b78d0b9c0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.360340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca821cfe1ef74dc18a5b2f5b78d0b9c0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:46.435966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1195/2404] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:46 2022] DELETE /identity/v3/users/ca821cfe1ef74dc18a5b2f5b78d0b9c0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:46.849659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:46.851292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:46.864539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0d0b5-750b-46d4-a374-2d124f529836 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:46.922571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:46.923457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:46.923735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:46.924005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] PATH_INFO: `/v3/projects/1200fc94bb4b4f058c7354d2afecb5dc` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:46.925259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1200fc94bb4b4f058c7354d2afecb5dc)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:46.927263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:46.930085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:47.048249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1200fc94bb4b4f058c7354d2afecb5dc', 'request_id': 'req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.054919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1200fc94bb4b4f058c7354d2afecb5dc', 'request_id': 'req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.162064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1200fc94bb4b4f058c7354d2afecb5dc', 'request_id': 'req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.173473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] The token cache is being invalidate because project 1200fc94bb4b4f058c7354d2afecb5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:47.173763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.174419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.175975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1210/2405] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:46 2022] DELETE /identity/v3/projects/1200fc94bb4b4f058c7354d2afecb5dc => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:47.180616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:47.182143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:47.195417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2595223-de20-49b3-943c-be75a242ce9d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:47.225014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:47.251419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:47.252318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:47.252604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:47.252910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] PATH_INFO: `/v3/users/fa3203878c6845228b7348ffaa172fac` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:47.254126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3203878c6845228b7348ffaa172fac)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:47.256075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:47.478333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3203878c6845228b7348ffaa172fac'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.489963 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3203878c6845228b7348ffaa172fac'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.497219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3203878c6845228b7348ffaa172fac'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.497899 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3203878c6845228b7348ffaa172fac'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.498503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-22890bcd-8bcd-4a89-ab50-ce2c979b1e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3203878c6845228b7348ffaa172fac'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:47.572996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1196/2406] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:47 2022] DELETE /identity/v3/users/fa3203878c6845228b7348ffaa172fac => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:47.969085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:47.970569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:47.984828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cadb2-fcdc-4449-9b61-9a2a0ce3f9c8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.050223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.051007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.051286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.051558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] PATH_INFO: `/v3/projects/362297cbd55a4210a993d5ede5320bef` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.052721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=362297cbd55a4210a993d5ede5320bef)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.054655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.155122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '362297cbd55a4210a993d5ede5320bef', 'request_id': 'req-f719eb64-1e10-46bc-8924-9f1a03085dac'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:48.161122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '362297cbd55a4210a993d5ede5320bef', 'request_id': 'req-f719eb64-1e10-46bc-8924-9f1a03085dac'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:48.230355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '362297cbd55a4210a993d5ede5320bef', 'request_id': 'req-f719eb64-1e10-46bc-8924-9f1a03085dac'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:48.240786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] The token cache is being invalidate because project 362297cbd55a4210a993d5ede5320bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:48.241065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:48.241675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f719eb64-1e10-46bc-8924-9f1a03085dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:48.243221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1211/2407] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:47 2022] DELETE /identity/v3/projects/362297cbd55a4210a993d5ede5320bef => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:48.249170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.249657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.249755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.268563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:48.270017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:48.329512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1197/2408] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:48.338760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.339049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.339326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.357672 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:48.358988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:48.367436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1212/2409] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:53:48.371671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.381166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c4769-714b-4a74-bcf1-7c72d9b7513f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.386683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.387326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.387609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.387885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.388603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:53:48.388913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.390535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.401778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1198/2410] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:53:48.406069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.415132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5093ff-556d-43f7-84af-4c7e077e4851 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.419734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.422339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.422339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.422339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.422339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.423610 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.436987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:48.529796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1213/2411] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:48 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:48.534959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.545579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656af0d4-bd9e-489d-adcd-6503906ee4da admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.583614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:48.603685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.604378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.604660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.604936 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.605617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.607558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.700630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1199/2412] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:48 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:48.704758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.715641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4189e-f6ca-44be-b452-4c7fea4bb965 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.720265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.720993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.721298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.721574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.722327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.723899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.735759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1214/2413] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:48.739064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.749094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00489a09-02ee-43eb-8688-bef5361da104 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.753769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.754445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.754731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.755002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.755798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.758158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53c945-e7be-41de-991c-eecac3072d3c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.768624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1200/2414] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:48.772937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.782715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39e726-6d83-4145-adab-60fe09406809 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:48.787570 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:48.788438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.788717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.788988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] PATH_INFO: `/v3/projects/80cb8c6ae64e4747bf626fd3ebfc1b33/users/f395335f18b94a439e88c7c137dab44d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.803333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80cb8c6ae64e4747bf626fd3ebfc1b33, user_id=f395335f18b94a439e88c7c137dab44d, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:48.806020 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:48.870985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1215/2415] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:48 2022] PUT /identity/v3/projects/80cb8c6ae64e4747bf626fd3ebfc1b33/users/f395335f18b94a439e88c7c137dab44d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:48.882654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:48.883213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:48.883489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:48.909756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] MFA Rules not processed for user `f395335f18b94a439e88c7c137dab44d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:48.911011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:48.975648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1201/2416] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:48.986663 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:48.988330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:49.046255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27a12d-2924-406f-a128-be74f3555e48 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:49.049936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:49.050579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:49.050862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:49.051139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:49.059725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:49.061145 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6870f92-c57d-40f7-8d61-85ce77cb0446 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:49.070499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1216/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:52.884568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:52.945322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b7277-67a9-469b-b4fe-c849c5ff058c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:52.949833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:52.950722 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:52.951009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:52.951284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] PATH_INFO: `/v3/users/f395335f18b94a439e88c7c137dab44d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:52.952467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f395335f18b94a439e88c7c137dab44d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:52.954417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:53.198593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f395335f18b94a439e88c7c137dab44d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:53.200409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:53.211014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f395335f18b94a439e88c7c137dab44d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:53.217621 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f395335f18b94a439e88c7c137dab44d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:53.218348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f395335f18b94a439e88c7c137dab44d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:53.223833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f395335f18b94a439e88c7c137dab44d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:53.327902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1202/2418] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:53:52 2022] DELETE /identity/v3/users/f395335f18b94a439e88c7c137dab44d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:53.332585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:53.333061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:53.333061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:53.350529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:53.351723 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:53.409519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1217/2419] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:53.419078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:53.421073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:53.477793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89c30-f041-46c8-a42b-4173bffde8e9 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:53.481331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:53.481998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:53.482284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:53.482591 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:53.491613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:53.493102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dfc0b-a02b-453e-93cb-723aacb51013 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:53.502720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1203/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:53:53.940387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:53.941809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:53.955097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8daea6-e20d-406c-b75a-f5aaa2f9d946 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:53.960036 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:53.960893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:53.961178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:53.961455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] PATH_INFO: `/v3/projects/80cb8c6ae64e4747bf626fd3ebfc1b33` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:53.962737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80cb8c6ae64e4747bf626fd3ebfc1b33)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:53.964650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.071869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80cb8c6ae64e4747bf626fd3ebfc1b33', 'request_id': 'req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:54.078000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80cb8c6ae64e4747bf626fd3ebfc1b33', 'request_id': 'req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:54.080465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:54.177900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80cb8c6ae64e4747bf626fd3ebfc1b33', 'request_id': 'req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:54.189600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] The token cache is being invalidate because project 80cb8c6ae64e4747bf626fd3ebfc1b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:53:54.189909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:54.190530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-a9f4fcbe-7b83-49f9-9418-4745e8b91d27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:53:54.192088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1218/2421] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:53:53 2022] DELETE /identity/v3/projects/80cb8c6ae64e4747bf626fd3ebfc1b33 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:54.197299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.197769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.197978 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.215538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:54.216732 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:54.274724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1204/2422] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:54.283458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.283748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.284028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.302388 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:54.304106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:54.311903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1219/2423] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:54.315946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.325699 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77408e0-2dfc-4fb7-a0b5-f51a99a49f1f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.330493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.331143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.331431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.331711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.332436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:53:54.332748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.334379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.345789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1205/2424] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:53:54.349695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.359196 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da9167-fecd-472a-867f-c5576ec2bbf6 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.363980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.364640 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.364922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.365195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.366533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.368450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.442063 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1220/2425] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:53:54 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:54.446024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.456244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c43796-0255-494f-becd-374ec7f57061 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.507612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:53:54.513870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.514562 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.514874 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.515154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.515855 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.517780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.625146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1206/2426] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:53:54 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:53:54.629224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.639849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4de2d-1d38-4fb1-8cea-640b4928192e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.644571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.645220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.645510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.645784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.646542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.648630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.660082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1221/2427] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:54.666141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.676408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469737c-c23b-4c4a-8584-0f87bcae3300 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.681423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.682380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.682673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.683273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.684059 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.685921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1c0bd-d858-47e6-ac0d-3c371b2f81a6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.696486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1207/2428] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:53:54.700608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.711182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517993f-cabf-4823-91d0-194286ba55ff admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.715826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.716687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.716972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.717248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] PATH_INFO: `/v3/projects/954726a4f5af427993e6d6c4f4869988/users/fcbcadf4140646abb8969fc69f17fba1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.732497 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954726a4f5af427993e6d6c4f4869988, user_id=fcbcadf4140646abb8969fc69f17fba1, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:54.737986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:54.837930 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1222/2429] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:53:54 2022] PUT /identity/v3/projects/954726a4f5af427993e6d6c4f4869988/users/fcbcadf4140646abb8969fc69f17fba1/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:53:54.842969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a147d-713e-4537-96a9-97227f95b155 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.843255 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a147d-713e-4537-96a9-97227f95b155 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.843528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a147d-713e-4537-96a9-97227f95b155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:54.861273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e55a147d-713e-4537-96a9-97227f95b155 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:53:54.863871 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e55a147d-713e-4537-96a9-97227f95b155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:54.921221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1208/2430] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:53:54.930752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:53:54.932433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:53:54.989975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232db7-2162-4a19-aeff-655dfa2fd8c1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:53:54.993668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:53:54.994343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:53:54.994632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:53:54.994908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:53:55.004249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:53:55.005688 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:53:55.016582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1223/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:00.316468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:00.317039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:00.317179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:00.351718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] MFA Rules not processed for user `fcbcadf4140646abb8969fc69f17fba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:00.353096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:00.429973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1209/2432] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:00.434591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:00.444864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f39b6-0832-4512-8e4f-6733ba786102 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:00.450752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:00.451849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:00.452483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:00.453070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:00.454117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:00.456256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:00.573626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1224/2433] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:54:00 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:54:00.574954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:00.588407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632380b7-6a0a-4560-a17d-bece26ac2712 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:00.699560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:00.700246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:00.700533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:00.700806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:00.701505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:00.703681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:00.713895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:00.809242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1210/2434] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:54:00 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:54:00.813234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:00.825427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa1aeb-71ea-4bf8-a425-179a16577f06 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:00.832136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:00.833171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:00.833450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:00.833987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:00.834761 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:00.836728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:00.852938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1225/2435] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:54:00.859206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:00.864982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7b2fc-bd44-44f8-86ab-e49888d975ce admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:00.870496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:00.871472 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:00.871830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:00.872197 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] PATH_INFO: `/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64/users/995aadfdfa734c38b5837f2681487963/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:00.889984 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f5576fc9fa465c8e8e09ba8b993b64, user_id=995aadfdfa734c38b5837f2681487963, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:00.892700 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:00.962648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1211/2436] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:54:00 2022] PUT /identity/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64/users/995aadfdfa734c38b5837f2681487963/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:54:00.966635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:00.977636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd8332-7c1f-4203-97e1-6ac60bbf95d1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:01.027239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:01.036960 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:01.042382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:01.042382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:01.042382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:01.042382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:01.042382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e8f10-384e-4978-b8f1-b50012b35581 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:01.052092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1226/2437] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:54:01.056370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:01.067010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95338519-637a-4cb7-8826-9f433910a6c2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:01.071858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:01.072745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:01.073029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:01.073303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] PATH_INFO: `/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64/users/995aadfdfa734c38b5837f2681487963/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:01.075398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f5576fc9fa465c8e8e09ba8b993b64, user_id=995aadfdfa734c38b5837f2681487963, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:01.078077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:01.090649 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1212/2438] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:54:01 2022] PUT /identity/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64/users/995aadfdfa734c38b5837f2681487963/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:54:07.172915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5354-ced8-4224-aed1-bbf868f0bc13 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:07.173462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5354-ced8-4224-aed1-bbf868f0bc13 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:07.173462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c5354-ced8-4224-aed1-bbf868f0bc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:07.201235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c26c5354-ced8-4224-aed1-bbf868f0bc13 None None] MFA Rules not processed for user `995aadfdfa734c38b5837f2681487963`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:07.202577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c26c5354-ced8-4224-aed1-bbf868f0bc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:07.277289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1227/2439] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:07 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:07.291845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:07.303919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:07.400851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b1b03-7e90-41f4-ba58-df0c37aa398f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:07.406457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:07.407117 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:07.407403 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:07.407682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:07.481479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:07.483119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab3639b-a274-41a8-b390-eead69f238ea service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:07.494237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1213/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:10.156244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:10.156774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:10.156895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:10.181296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] MFA Rules not processed for user `fcbcadf4140646abb8969fc69f17fba1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:10.183179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:10.190680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1228/2441] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:17.488533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:18.387318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:18.387608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:18.387889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:18.407443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:18.408657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:18.466557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1214/2442] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:54:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:18.509843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:18.512918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:18.589959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b925260-cb49-4e75-84b1-24c2017ce6ea None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:18.595309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:18.595955 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:18.596235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:18.596506 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:18.605290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:18.606899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28cdff1-8295-4600-a3e4-1c29ab6e8e83 service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:18.615516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1229/2443] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:54:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:54:28.461115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=25 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:28.612466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=75 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:33.828944 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:33.830605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:33.911026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87703c54-ef77-4218-8af9-06203de8fd55 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:33.916685 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:33.917324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:33.917610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:33.917916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:33.919703 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:33.931868 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:33.941781 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a175e98f-fbef-4c2e-a5a2-33de82ff7dbb service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:33.943325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1215/2444] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:40.444754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.445343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.445343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.446818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1230/2445] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:54:40.453456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eef28e-70a5-487d-9b28-2257738c96c1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.454006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eef28e-70a5-487d-9b28-2257738c96c1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.454115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eef28e-70a5-487d-9b28-2257738c96c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.472530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b6eef28e-70a5-487d-9b28-2257738c96c1 None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:40.473788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b6eef28e-70a5-487d-9b28-2257738c96c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:40.483827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1216/2446] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:40.498724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:40.500419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:40.564977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b65c77-5c70-499a-b0d8-b86b4266733a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:40.568517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52be421a60704a2f83174973f5d9cfcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:40.569168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.569478 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.569751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.581517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:40.583078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdbd33-4b19-4a58-8e43-67216f64331a service glance] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:40.595892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1231/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:40.881765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc19a0-3d43-4a3c-900f-34fd032a221d None None] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.882006 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc19a0-3d43-4a3c-900f-34fd032a221d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.882285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc19a0-3d43-4a3c-900f-34fd032a221d None None] PATH_INFO: `/` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.883914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1217/2448] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:54:40.888954 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fe8a-84c0-4f2b-829f-3cf62b0b0d7b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.889240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fe8a-84c0-4f2b-829f-3cf62b0b0d7b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.893515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6fe8a-84c0-4f2b-829f-3cf62b0b0d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.907998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ede6fe8a-84c0-4f2b-829f-3cf62b0b0d7b None None] MFA Rules not processed for user `05b58dde8d4a426ead9dda4363cb82a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:40.909198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ede6fe8a-84c0-4f2b-829f-3cf62b0b0d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:40.960065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1232/2449] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:40.971377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc19a0-3d43-4a3c-900f-34fd032a221d None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:40.983150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbc19a0-3d43-4a3c-900f-34fd032a221d None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:40.986777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:40.987413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:40.987698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:40.987972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:40.995202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:40.996616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0521ef2-c344-4470-8dff-1cf543b1a8a2 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:41.004606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1218/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:41.085190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b18a9-635c-454b-beba-6e002b113749 None None] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:41.085481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b18a9-635c-454b-beba-6e002b113749 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:41.085766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7b18a9-635c-454b-beba-6e002b113749 None None] PATH_INFO: `/` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:41.087190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1233/2451] 10.222.0.42 () {54 vars in 921 bytes} [Fri Jun 24 03:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 03:54:41.092378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6c12-4e75-4ae0-97a5-c64b38399a9d None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:41.092666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6c12-4e75-4ae0-97a5-c64b38399a9d None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:41.092946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a6c12-4e75-4ae0-97a5-c64b38399a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:41.111478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8f8a6c12-4e75-4ae0-97a5-c64b38399a9d None None] MFA Rules not processed for user `99eac0e91e884f4c8e1c93f7f66d43a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:41.112679 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8f8a6c12-4e75-4ae0-97a5-c64b38399a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:41.121979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1219/2452] 10.222.0.42 () {58 vars in 1018 bytes} [Fri Jun 24 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:41.132182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b18a9-635c-454b-beba-6e002b113749 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:41.143491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7b18a9-635c-454b-beba-6e002b113749 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:41.147606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:41.148275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:41.148555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:41.148832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:41.159188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:41.160614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:41.171857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1234/2453] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:45.401900 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:45.404805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:45.404805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:45.438765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:45.440002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:45.461173 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1220/2454] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:45.479727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:45.496927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40bfe6-c1bd-4a55-b327-53d9be56027b service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:45.507680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:45.508810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:45.509258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:45.509699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:45.520910 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:45.523585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:45.534985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1235/2455] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:54:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:54:51.943898 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:51.954191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e9615-8590-4134-bc83-7292386e3f2a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:51.958678 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:51.959622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:51.960141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:51.960636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:51.962793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:52.046037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:52.047765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:52.059885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1221/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:55.530349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=61 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:56.267705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:56.269367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:56.284775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61f02a-7974-43e9-865a-39b6953626ae service swift] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:56.290275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:56.290921 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:56.291303 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:56.291460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:56.293251 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:56.306705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:56.308282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:56.321976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1236/2457] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:54:56.420003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:56.422092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:56.436180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237cfc6-1bfe-4e03-a497-459dbdc5b8b4 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:56.440960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:56.441817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:56.442133 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:56.442409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] PATH_INFO: `/v3/users/715bb36a29d743e1b8b0fbad427efcd5` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:56.444412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715bb36a29d743e1b8b0fbad427efcd5)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:56.447107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:56.619237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:56.621108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715bb36a29d743e1b8b0fbad427efcd5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:56.634108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715bb36a29d743e1b8b0fbad427efcd5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:56.641433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715bb36a29d743e1b8b0fbad427efcd5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:56.642218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715bb36a29d743e1b8b0fbad427efcd5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:56.642832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f0beffe0-a716-4fa4-a8bc-4edb157792c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715bb36a29d743e1b8b0fbad427efcd5'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:56.754850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1222/2458] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:54:56 2022] DELETE /identity/v3/users/715bb36a29d743e1b8b0fbad427efcd5 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:54:56.984182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:56.999860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d105ce-0604-44d3-a479-c0c94d45da10 service placement] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.059908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.060852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.061137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.061412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] PATH_INFO: `/v3/projects/142662249337437ab58aa69811ad0a38` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.062612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=142662249337437ab58aa69811ad0a38)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.064494 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.182456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142662249337437ab58aa69811ad0a38', 'request_id': 'req-ad8d843d-521a-40a0-bd98-35d11e84b74e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:57.188496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142662249337437ab58aa69811ad0a38', 'request_id': 'req-ad8d843d-521a-40a0-bd98-35d11e84b74e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:57.239792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142662249337437ab58aa69811ad0a38', 'request_id': 'req-ad8d843d-521a-40a0-bd98-35d11e84b74e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:57.250364 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] The token cache is being invalidate because project 142662249337437ab58aa69811ad0a38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:54:57.250650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:57.251269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8d843d-521a-40a0-bd98-35d11e84b74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:54:57.252833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1237/2459] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:54:56 2022] DELETE /identity/v3/projects/142662249337437ab58aa69811ad0a38 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:54:57.258277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.258835 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.259112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.278142 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:57.279350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:57.337785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1223/2460] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:57.345343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.345632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.345948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.377878 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:57.384005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:57.388682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1238/2461] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:57.392819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.403158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c188aaea-aff6-44eb-8f4f-cf4b3d337d17 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.409617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.409617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.409617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.409617 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.410123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:54:57.410390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.412026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.424721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1224/2462] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:54:57.429548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.439165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dabe94-be2f-46c1-9250-ae396d78a11d None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.444554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.445631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.445631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.445889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.446493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.448756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.529587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1239/2463] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:54:57 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:54:57.533711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.544317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4cbc-036d-47ea-9cad-5ca4b7f98a52 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.605920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.606593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.606882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.607158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.607860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.609811 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.704075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1225/2464] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:54:57 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:54:57.708033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.718411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb79535-d208-4b59-ac74-7043cdbb00f1 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.723198 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.724430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.724712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.724987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.725780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.731206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.739480 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1240/2465] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:54:57.744166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.754237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bd970-19af-47ac-987d-c943c73fca84 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.759300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.759959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.760240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.760516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.761237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.762847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f65f17-6f4d-41f7-b54e-b1e7ef71f164 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.772872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1226/2466] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:54:57.777037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.787373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f5b73-3e7d-4c49-807a-0796ed682f86 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:57.792477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:57.793348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.793625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.793938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] PATH_INFO: `/v3/projects/c585cf5ad3f4482f8305f9dde0a2632e/users/dcbe75cb0bf94efa9f7a7e883e1157dd/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.809434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c585cf5ad3f4482f8305f9dde0a2632e, user_id=dcbe75cb0bf94efa9f7a7e883e1157dd, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:57.812128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:57.870165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1241/2467] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:54:57 2022] PUT /identity/v3/projects/c585cf5ad3f4482f8305f9dde0a2632e/users/dcbe75cb0bf94efa9f7a7e883e1157dd/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:54:57.881099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:57.881389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:57.881665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:57.908551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] MFA Rules not processed for user `dcbe75cb0bf94efa9f7a7e883e1157dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:54:57.909742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:57.927609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:57.979052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1227/2468] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:54:57.985524 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:54:57.987320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:54:58.002874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:54:58.063535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440fc7e-f6ce-4b64-9be6-c904ded94715 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:54:58.069818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:54:58.070591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:54:58.070879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:54:58.071159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:54:58.078920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:54:58.080530 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99828b0-84c1-4e21-aff2-eb43a44bccc7 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:54:58.091003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1242/2469] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:54:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:01.283283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:01.339777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633151d-126d-4251-bb4e-4c7b73826fbe None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:01.344624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:01.345514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:01.345801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:01.346107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] PATH_INFO: `/v3/users/dcbe75cb0bf94efa9f7a7e883e1157dd` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:01.347298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcbe75cb0bf94efa9f7a7e883e1157dd)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:01.349903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:01.482756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcbe75cb0bf94efa9f7a7e883e1157dd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:01.494343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcbe75cb0bf94efa9f7a7e883e1157dd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:01.501139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcbe75cb0bf94efa9f7a7e883e1157dd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:01.501809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcbe75cb0bf94efa9f7a7e883e1157dd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:01.502445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcbe75cb0bf94efa9f7a7e883e1157dd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:01.582792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1228/2470] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:01 2022] DELETE /identity/v3/users/dcbe75cb0bf94efa9f7a7e883e1157dd => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:01.587811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:01.588291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:01.588400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:01.605400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:01.606633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:01.667033 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1243/2471] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:01.676673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:01.678144 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:01.720986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:01.736143 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db5a8d-42a6-4b91-b4f9-6e39286064b2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:01.739987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:01.740633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:01.740924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:01.741212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:01.750506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:01.751938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca261ea-862c-4cab-81fb-10ba6dd43810 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:01.762625 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1229/2472] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:02.158594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.160704 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:02.183416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55cb92-0dcf-4e21-8fe0-bdc0416743fa None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.189067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.189962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.190249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.190553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] PATH_INFO: `/v3/projects/c585cf5ad3f4482f8305f9dde0a2632e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.191743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c585cf5ad3f4482f8305f9dde0a2632e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.194342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.307315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c585cf5ad3f4482f8305f9dde0a2632e', 'request_id': 'req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:02.314252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c585cf5ad3f4482f8305f9dde0a2632e', 'request_id': 'req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:02.377229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c585cf5ad3f4482f8305f9dde0a2632e', 'request_id': 'req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:02.388881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] The token cache is being invalidate because project c585cf5ad3f4482f8305f9dde0a2632e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:02.389259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:02.389801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f9e814e1-00f9-4f9f-b38b-98ac618a5a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:02.391420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1244/2473] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:02 2022] DELETE /identity/v3/projects/c585cf5ad3f4482f8305f9dde0a2632e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:02.396277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.396774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.396880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.415634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:02.416884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:02.480242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1230/2474] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:02.488284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.488440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.489041 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.511929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:02.513085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:02.521540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1245/2475] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:02.525753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.535444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba0c33-b8fc-4b87-b1b9-67f9a403d862 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.540194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.540924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.541230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.541493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.542244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:02.542557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.544170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.555814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1231/2476] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:02.559998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.569821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc938f7a-35e0-4f88-8632-37c3d1f72612 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.574617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.575262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.575598 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.575880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.576581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.578539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.592386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:02.675684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1246/2477] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:02 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:02.680838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.692310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cda41c-e4bc-480c-8db2-678adf3545ed admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.751369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.752952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.753232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.753505 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.754279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.758153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.878665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1232/2478] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:02 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:02.880584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.891095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a8deb-6a14-4ad3-a663-695b0328ffe7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.895909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.896566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.896853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.897123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.897912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.899512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.909952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1247/2479] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:02.913827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.924994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af8c51-b821-4e0d-b1e7-4679af6b2f1f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.930298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.930947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.931229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.931503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.932319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.933990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8620f-68d7-4c74-a379-fead9830c84f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:02.944482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1233/2480] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:02.948650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:02.958616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99a92e-a0e7-411e-b593-485efc6507a6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:02.963210 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:02.964076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:02.964357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:02.965098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] PATH_INFO: `/v3/projects/5a7edaa87edf486585601b0138173b33/users/34a2fc4a61974cd1911700db203428be/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:02.981065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7edaa87edf486585601b0138173b33, user_id=34a2fc4a61974cd1911700db203428be, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:02.983732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.045417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1248/2481] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:02 2022] PUT /identity/v3/projects/5a7edaa87edf486585601b0138173b33/users/34a2fc4a61974cd1911700db203428be/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:03.056410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.056730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.057013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.083399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] MFA Rules not processed for user `34a2fc4a61974cd1911700db203428be`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:03.084622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:03.118239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:03.148461 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1234/2482] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:03.153120 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.220070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f9d2a-f15e-4c23-942c-3fc096b00458 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.230416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.231097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.231377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.231648 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.233027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.235654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.357039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1249/2483] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:03 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:03.358367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.375044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20724b55-3941-426f-bbc9-3a6cfb8e26cd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.448914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.449646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.450503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.450787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.451500 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.453382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.590768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1235/2484] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:03 2022] POST /identity/v3/users => generated 291 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:03.602140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.613381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746eee1a-5fca-453b-828a-7dd25469c7e8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.619732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.619846 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.620127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.620378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.621427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.622823 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.639200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1250/2485] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:03.640564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.653273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590a1e1-c3f5-4c1f-bfad-a0de798d28fd admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.660494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.667543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.667543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.667543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] PATH_INFO: `/v3/projects/e119ee4bbefe4180a4576d52cbf1b281/users/789f16299e7b4d37855654fd917017bb/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.683865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e119ee4bbefe4180a4576d52cbf1b281, user_id=789f16299e7b4d37855654fd917017bb, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.689491 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.837444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1236/2486] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:03 2022] PUT /identity/v3/projects/e119ee4bbefe4180a4576d52cbf1b281/users/789f16299e7b4d37855654fd917017bb/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:03.842129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.852950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f842613-d232-4cc9-a6cd-45022ea18e93 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.924109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.928179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.928179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.928179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.928179 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.928569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:03.928671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.928671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.943040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1251/2487] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:03.944092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:03.954260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44c4c9-c06e-4fe0-879f-ac8436d9ce97 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:03.961373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:03.962416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:03.962706 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:03.962976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] PATH_INFO: `/v3/projects/e119ee4bbefe4180a4576d52cbf1b281/users/789f16299e7b4d37855654fd917017bb/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:03.966404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e119ee4bbefe4180a4576d52cbf1b281, user_id=789f16299e7b4d37855654fd917017bb, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:03.969186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a445716-1528-4c46-9bf3-b83517487cc7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:03.986961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1252/2488] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:03 2022] PUT /identity/v3/projects/e119ee4bbefe4180a4576d52cbf1b281/users/789f16299e7b4d37855654fd917017bb/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:03.987336 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c06d94-1d98-4852-b277-d52807a13a6c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:04.001252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:04.001883 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:04.002159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:04.036402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] MFA Rules not processed for user `789f16299e7b4d37855654fd917017bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:04.038698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:04.042296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:04.066366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:04.067056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:04.067866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:04.068148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:04.070237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:04.081176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:04.144519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:04.145352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1253/2489] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:03 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:04.146056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:04.157950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1237/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:04.158148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:04.158148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:04.218994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e044d56-82ff-4176-8abf-ee2b801b2008 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:04.223079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:04.223790 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:04.224074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:04.224350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:04.234102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:04.236019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1bc4c-dfb5-4e4e-a653-3e4d5135d4ae service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:04.246328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1254/2491] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:04.358226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:04.359734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:04.371397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8888bd-23b3-4b01-9205-4706317b3c08 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:04.375036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:04.375672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:04.375951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:04.376225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:04.433066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:04.434458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:04.444768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1238/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:07.955874 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:07.956533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:07.956533 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:07.974934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:07.976227 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:08.031907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1255/2493] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:55:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:08.045164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:08.046574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:08.115438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605aa4-ac99-418b-bb0f-b8a7f9bb277e service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:08.120648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:08.121610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:08.121727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:08.121997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:08.131341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:08.132970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2863972-8cd5-4cad-ab2f-7a12535652f1 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:08.141349 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1239/2494] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:55:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:55:09.465920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:09.514262 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:09.529129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654c7f4-a3c2-42f9-9e90-082caa32a4c9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:09.533655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:09.534553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:09.534836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:09.535108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] PATH_INFO: `/v3/users/34a2fc4a61974cd1911700db203428be` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:09.536891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a2fc4a61974cd1911700db203428be)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:09.538828 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:09.694509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a2fc4a61974cd1911700db203428be'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:09.706241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a2fc4a61974cd1911700db203428be'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:09.773067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a2fc4a61974cd1911700db203428be'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:09.773743 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a2fc4a61974cd1911700db203428be'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:09.784339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a2fc4a61974cd1911700db203428be'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:09.794207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1256/2495] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:09 2022] DELETE /identity/v3/users/34a2fc4a61974cd1911700db203428be => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:09.795721 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:09.796182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:09.796330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:09.814910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:09.816135 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:09.856820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:09.899929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1240/2496] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:09.920302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:09.921923 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:09.999025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b07e0-e23d-46a5-acc4-60768162902b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:10.003160 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:10.005310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:10.005660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:10.006054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:10.015969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:10.017406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:10.027986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1257/2497] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:10.529448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:10.529448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:10.536910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5188b26-4d45-45f4-a9c2-24f5be0a967a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:10.558265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:10.558265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:10.558265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:10.558265 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] PATH_INFO: `/v3/projects/5a7edaa87edf486585601b0138173b33` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:10.558897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7edaa87edf486585601b0138173b33)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:10.558897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:10.713510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7edaa87edf486585601b0138173b33', 'request_id': 'req-485eccfc-2b76-4d0d-9121-7d68c16badcd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:10.719175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7edaa87edf486585601b0138173b33', 'request_id': 'req-485eccfc-2b76-4d0d-9121-7d68c16badcd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:10.904313 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7edaa87edf486585601b0138173b33', 'request_id': 'req-485eccfc-2b76-4d0d-9121-7d68c16badcd'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:10.916990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] The token cache is being invalidate because project 5a7edaa87edf486585601b0138173b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:10.917395 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:10.918132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:10.919772 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1241/2498] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:10 2022] DELETE /identity/v3/projects/5a7edaa87edf486585601b0138173b33 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:10.923805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:10.934446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36233cf-54bd-4804-aa6c-caff199ac523 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:10.995556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:10.996891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:10.996891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:10.997085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] PATH_INFO: `/v3/users/789f16299e7b4d37855654fd917017bb` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:10.998389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789f16299e7b4d37855654fd917017bb)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:11.000864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:11.022165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:11.207055 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789f16299e7b4d37855654fd917017bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.228259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789f16299e7b4d37855654fd917017bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.299111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789f16299e7b4d37855654fd917017bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.299777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789f16299e7b4d37855654fd917017bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.311112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-523935ae-9d9e-497d-83b2-41d7ba6ee107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789f16299e7b4d37855654fd917017bb'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.335653 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1258/2499] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:10 2022] DELETE /identity/v3/users/789f16299e7b4d37855654fd917017bb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:11.751575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:11.753115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:11.769460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485eccfc-2b76-4d0d-9121-7d68c16badcd admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:11.832570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:11.833563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:11.833787 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:11.836004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] PATH_INFO: `/v3/projects/e119ee4bbefe4180a4576d52cbf1b281` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:11.836004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e119ee4bbefe4180a4576d52cbf1b281)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:11.837356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:11.940217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e119ee4bbefe4180a4576d52cbf1b281', 'request_id': 'req-803a0d4e-b2da-473a-9ae5-d2b538e1116d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.948316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e119ee4bbefe4180a4576d52cbf1b281', 'request_id': 'req-803a0d4e-b2da-473a-9ae5-d2b538e1116d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:11.950993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:12.065619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e119ee4bbefe4180a4576d52cbf1b281', 'request_id': 'req-803a0d4e-b2da-473a-9ae5-d2b538e1116d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:12.078769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] The token cache is being invalidate because project e119ee4bbefe4180a4576d52cbf1b281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:12.078991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:12.079664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-803a0d4e-b2da-473a-9ae5-d2b538e1116d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:12.081210 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1242/2500] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:11 2022] DELETE /identity/v3/projects/e119ee4bbefe4180a4576d52cbf1b281 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:12.086337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.086793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.086902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.105385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:12.106650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:12.169785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1259/2501] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:12.178341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.178631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.178914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.197666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:12.198915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:12.207031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1243/2502] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:12.211332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.221031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c85e0f-3392-408a-8f4e-deba758264a7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.226104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.227038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.227326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.227596 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.228311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:12.228614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.230220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.242208 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1260/2503] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:12.250409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.259908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef39f1-4283-4edf-9a5e-53d9822b580c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.264600 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.265243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.265528 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.265806 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.266529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.268421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.344776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1244/2504] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:12.349658 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.359754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c26ee4-f080-4fe0-973b-177cbffdf8a8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.417612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.418334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.418623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.418909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.419599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.421551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.501766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1261/2505] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/users => generated 305 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:12.502943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.514332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155657b9-44df-4d3b-8489-2367cbb52066 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.518823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.519480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.519764 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.520039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.521250 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.522915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.534186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1245/2506] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:12.538784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.549140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f51fb-a103-4cd7-a913-c187ed279c56 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.553988 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.554654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.554942 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.555221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.555952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.557684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee49e34-1b39-4e79-90df-c2c973cc5c02 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.559253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:12.569404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1262/2507] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:12.575535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.586220 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c86181-85c9-4c0b-ad4d-dd74c3a8fa6b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.591362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.592315 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.592607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.592886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] PATH_INFO: `/v3/projects/9f21a6bacd2147e7a61af06ceff06c29/users/214db2d2c552451593b092620813c09b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.611022 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f21a6bacd2147e7a61af06ceff06c29, user_id=214db2d2c552451593b092620813c09b, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.613629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:12.748425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1246/2508] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:12 2022] PUT /identity/v3/projects/9f21a6bacd2147e7a61af06ceff06c29/users/214db2d2c552451593b092620813c09b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:12.757507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.757795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.758108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.787149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] MFA Rules not processed for user `214db2d2c552451593b092620813c09b`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:12.788439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:12.855982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1263/2509] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:12.860376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:12.923931 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97ead3-327c-40b5-ae93-49063f002bdf admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:12.928832 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:12.933563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:12.933563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:12.933563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:12.933563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:12.933563 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.015111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1247/2510] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:12 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:13.019175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.030962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b776807-b212-4ce5-8507-f4a88c582961 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.090335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.091012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.091267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.091540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.092277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.094288 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.210573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1264/2511] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:13 2022] POST /identity/v3/users => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:13.211922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.224170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563181c-1719-4196-8f77-32c1406ec311 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.230155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.233511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.233511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.233511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.233511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.234396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.249893 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1248/2512] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:13.252819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.264131 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5a253-9776-474e-8793-b43f1494aa0f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.268840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.269814 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.270127 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.270435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] PATH_INFO: `/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219/users/fce3af2b679242a3aee1d5d34c086955/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.286934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc7015eb9dc4a2389bafcbfa62ad219, user_id=fce3af2b679242a3aee1d5d34c086955, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.289601 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.440154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1265/2513] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:13 2022] PUT /identity/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219/users/fce3af2b679242a3aee1d5d34c086955/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:13.444932 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.455065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66f0b6-5e00-4162-a088-dbdf3a2da16e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.512738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.513324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.513610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.513919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.514648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.516225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058d31d-d9a6-4301-a9ac-4042e0184326 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.517524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:13.526904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1249/2514] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:13.531089 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.542014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838ca8c3-f939-41d2-a9ef-ed019aacc89d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.546970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.547861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.548148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.548424 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] PATH_INFO: `/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219/users/fce3af2b679242a3aee1d5d34c086955/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.550481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc7015eb9dc4a2389bafcbfa62ad219, user_id=fce3af2b679242a3aee1d5d34c086955, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.553877 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.564277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1266/2515] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:13 2022] PUT /identity/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219/users/fce3af2b679242a3aee1d5d34c086955/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:13.575606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.575901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.576185 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.603074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] MFA Rules not processed for user `fce3af2b679242a3aee1d5d34c086955`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:13.604283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:13.673160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1250/2516] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:13.684280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:13.686097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:13.728289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:13.743924 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2213940-6788-41dd-a5f1-131274061b70 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:13.747765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:13.748436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:13.748719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:13.749048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:13.758226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:13.759902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:13.769332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1267/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:14.134762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:14.145081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d952f4-0c4b-4240-a41c-1720572a9898 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:14.149218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:14.149881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:14.150182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:14.150478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:14.206840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:14.208616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:14.217663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1251/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:17.509122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:17.510633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:17.568090 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e713f-b386-45d0-9313-01470ac5dba4 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:17.571609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:17.572240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:17.572520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:17.572795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:17.574511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:17.638725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:17.640157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad9c9c-faa9-4825-9ed7-5c7a6113fabc service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:17.650448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1268/2519] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:21.152030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:21.166689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85997386-2c57-43e6-9a17-e8c417e7271a service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:21.172635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:21.173730 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:21.174165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:21.174438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] PATH_INFO: `/v3/users/214db2d2c552451593b092620813c09b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:21.176891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] RBAC: Authorizing `identity:delete_user(user_id=214db2d2c552451593b092620813c09b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:21.179540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:21.420093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214db2d2c552451593b092620813c09b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.439449 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214db2d2c552451593b092620813c09b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.448888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214db2d2c552451593b092620813c09b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.448888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214db2d2c552451593b092620813c09b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.449588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214db2d2c552451593b092620813c09b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.451705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:21.527356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1252/2520] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:21 2022] DELETE /identity/v3/users/214db2d2c552451593b092620813c09b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:21.532334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:21.532974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:21.532974 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:21.548120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:21.549338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:21.559244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:21.560449 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:21.632081 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1269/2521] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:21.632326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04905-25e9-4bc2-ad77-c9f21963913c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:21.637031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:21.638304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:21.638598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:21.638876 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] PATH_INFO: `/v3/users/0bd253c869e7428ca8765eeb8e8122f8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:21.638986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:21.640335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bd253c869e7428ca8765eeb8e8122f8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:21.640507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:21.642412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:21.682681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:21.705751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595b195-cf65-4889-ab9f-65d95e2fb5be None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:21.710017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:21.710685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:21.710967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:21.711240 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:21.720750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:21.723792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:21.733074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1270/2522] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:21.865393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bd253c869e7428ca8765eeb8e8122f8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.877052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bd253c869e7428ca8765eeb8e8122f8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.884262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bd253c869e7428ca8765eeb8e8122f8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.884927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bd253c869e7428ca8765eeb8e8122f8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.885552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bd253c869e7428ca8765eeb8e8122f8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:21.990350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1253/2523] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:21 2022] DELETE /identity/v3/users/0bd253c869e7428ca8765eeb8e8122f8 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:22.180616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:22.182084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:22.198256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7fb022-5ca5-49cc-b027-3654a2a33265 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:22.263654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:22.264652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:22.264943 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:22.265225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] PATH_INFO: `/v3/projects/9f21a6bacd2147e7a61af06ceff06c29` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:22.266508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f21a6bacd2147e7a61af06ceff06c29)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:22.268628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:22.380104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f21a6bacd2147e7a61af06ceff06c29', 'request_id': 'req-95b0316a-a110-4f33-a3ae-89ea36e79c02'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.387339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f21a6bacd2147e7a61af06ceff06c29', 'request_id': 'req-95b0316a-a110-4f33-a3ae-89ea36e79c02'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.498283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f21a6bacd2147e7a61af06ceff06c29', 'request_id': 'req-95b0316a-a110-4f33-a3ae-89ea36e79c02'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.506446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:22.514407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:22.514631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] The token cache is being invalidate because project 9f21a6bacd2147e7a61af06ceff06c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:22.514631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.514631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.514948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1271/2524] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:22 2022] DELETE /identity/v3/projects/9f21a6bacd2147e7a61af06ceff06c29 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:22.519125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:22.521128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:22.540836 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d1ca-d2a0-4973-b831-4d800e8381c2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:22.587783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0316a-a110-4f33-a3ae-89ea36e79c02 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:22.592566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:22.593433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:22.593718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:22.594027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] PATH_INFO: `/v3/users/fce3af2b679242a3aee1d5d34c086955` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:22.595245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce3af2b679242a3aee1d5d34c086955)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:22.597152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:22.601529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:22.601820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:22.602552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:22.602839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:22.603115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] PATH_INFO: `/v3/projects/11935500e1cf4c749c6d3f77dbfa1146` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:22.604286 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=11935500e1cf4c749c6d3f77dbfa1146)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:22.606198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:22.618638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:22.746811 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce3af2b679242a3aee1d5d34c086955'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.747036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11935500e1cf4c749c6d3f77dbfa1146', 'request_id': 'req-b02c4ac2-b273-4c37-8310-a321a24efbbf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.752535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11935500e1cf4c749c6d3f77dbfa1146', 'request_id': 'req-b02c4ac2-b273-4c37-8310-a321a24efbbf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.759068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce3af2b679242a3aee1d5d34c086955'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.818222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11935500e1cf4c749c6d3f77dbfa1146', 'request_id': 'req-b02c4ac2-b273-4c37-8310-a321a24efbbf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.830568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] The token cache is being invalidate because project 11935500e1cf4c749c6d3f77dbfa1146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:22.830859 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.831510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b02c4ac2-b273-4c37-8310-a321a24efbbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.833580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1254/2525] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:22 2022] DELETE /identity/v3/projects/11935500e1cf4c749c6d3f77dbfa1146 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:22.839218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:22.839507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:22.839788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:22.858045 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:22.859279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:22.869486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce3af2b679242a3aee1d5d34c086955'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.870270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce3af2b679242a3aee1d5d34c086955'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.878290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-bc8dc97c-790a-4dbd-81f7-6823735144b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce3af2b679242a3aee1d5d34c086955'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:22.884510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1272/2526] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:22 2022] DELETE /identity/v3/users/fce3af2b679242a3aee1d5d34c086955 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:22.922733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1255/2527] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:22.931205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:22.931565 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:22.931940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:22.949713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:22.951025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.013182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1273/2528] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:23.017498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.027825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9510f12-67b9-4a6a-ace2-c5766f3b22f3 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.032839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.033603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.033915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.034193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.034959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:23.035270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.036920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.049246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1256/2529] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:23.054071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.063579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45014604-d7b0-4163-a849-3ab22e9c3737 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.068997 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.069462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.074043 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.074399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.075486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.077615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.148142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1274/2530] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:23.150884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.161593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e92c9-3d56-4a60-a8c8-2e47891d8395 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.218071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.218740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.219029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.219326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.220014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.221970 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.260398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.262338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.275896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5932e9aa-3f57-4b5c-9791-24f6d42ddcdf admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.281458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.281981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.282313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.282529 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] PATH_INFO: `/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.283731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc7015eb9dc4a2389bafcbfa62ad219)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.285644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.293415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1257/2531] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:23.294557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.304365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab102-3081-43fb-9eb0-17b61e97a62f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.309024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.309671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.309991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.310268 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.310992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.312666 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.323161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1258/2532] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:23.326872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.336797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014aadf-d4d7-43f8-b13a-d8f7afe56717 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.348389 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.349073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.349363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.349647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.350424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.353298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.354791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:23.368264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1259/2533] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:23.369510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.379071 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc7015eb9dc4a2389bafcbfa62ad219', 'request_id': 'req-43bd4c80-11a4-43c0-851a-16702a741087'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:23.379759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2732b2-219b-4c7c-8f42-3c7304b50d19 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.386702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc7015eb9dc4a2389bafcbfa62ad219', 'request_id': 'req-43bd4c80-11a4-43c0-851a-16702a741087'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:23.389349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:23.436307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.437249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.437533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.437809 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] PATH_INFO: `/v3/projects/8395b006fa8449c6ac3ba0a45c086a9e/users/d4492c271e404708ae68553dc4dc6010/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.440590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc7015eb9dc4a2389bafcbfa62ad219', 'request_id': 'req-43bd4c80-11a4-43c0-851a-16702a741087'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:23.452327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] The token cache is being invalidate because project ebc7015eb9dc4a2389bafcbfa62ad219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:23.452515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8395b006fa8449c6ac3ba0a45c086a9e, user_id=d4492c271e404708ae68553dc4dc6010, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.452619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:23.453463 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-43bd4c80-11a4-43c0-851a-16702a741087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:23.455010 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255be5a-7048-4453-8109-bba4505ca3e5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.455153 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1275/2534] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:23 2022] DELETE /identity/v3/projects/ebc7015eb9dc4a2389bafcbfa62ad219 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:23.459765 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cc73-045d-4d8f-8c66-007ee3ca45eb None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.460054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cc73-045d-4d8f-8c66-007ee3ca45eb None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.460335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0cc73-045d-4d8f-8c66-007ee3ca45eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.478538 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-dde0cc73-045d-4d8f-8c66-007ee3ca45eb None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:23.479732 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dde0cc73-045d-4d8f-8c66-007ee3ca45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.487619 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1276/2535] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:23.495611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.495922 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.496195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.513641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:23.514905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.520388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1260/2536] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:23 2022] PUT /identity/v3/projects/8395b006fa8449c6ac3ba0a45c086a9e/users/d4492c271e404708ae68553dc4dc6010/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:23.531477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.533922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.533922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.563371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] MFA Rules not processed for user `d4492c271e404708ae68553dc4dc6010`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:23.564684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.577713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1277/2537] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:23.583858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.597876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd24093-4b47-4852-89f7-31b9a8c28ab2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.604457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.605254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.605635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.606111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.607013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:23.607425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.609331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.623963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1278/2538] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:55:23.634651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.635180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1261/2539] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:23.639406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.640684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:23.645372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150d7e-7378-47df-be30-a7b8f217ddf5 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.650190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.650838 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.651133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.651404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.652104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.654013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.654808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcfb4e-18f2-4aff-a3c5-3a6d07e804c1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.659748 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.660409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.661280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.661673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.662306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.664365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.756679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1279/2540] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:23.761087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.809171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1262/2541] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:23.813110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:23.824574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3a86-e868-4f73-8d37-69c6cff6d8f6 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.863628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:23.873635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:23.877672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb1936-928d-4a4b-a473-59c396cc3fd2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:23.883578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.883578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.883578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.884159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.884457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:23.884619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.885125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:23.885406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:23.885679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:23.886396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:23.886559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.888285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:23.998612 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1263/2542] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:23.999682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.010222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe9bf-d9b4-478e-b179-688cdeeb9ec6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.015244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.015890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.016177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.016453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.017169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.018788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.022107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1280/2543] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:23 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:24.024793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.030797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1264/2544] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:24.034839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.038095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918202d-9817-4139-afa2-e4cdb90fe7e3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.042934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.043592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.043879 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.044099 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51d3e4-1126-4bd4-83ad-f6b05d115084 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.044219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.044875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.046513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.048738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.049588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.049891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.050804 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] PATH_INFO: `/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04/users/9fdc9d070946472c842a31c3ea585d6b/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.056502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1281/2545] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:24.060733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.064763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff96e3e5cfc24ad0b35b8743453caf04, user_id=9fdc9d070946472c842a31c3ea585d6b, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.068182 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.071172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144142d2-8490-4d81-8341-3f7b37a4d6aa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.075762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.082362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.082362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.082362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.082362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.082362 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.090438 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1282/2546] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:24.094175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.104350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddec2b6-377f-433b-a5a2-d1e37a5328bf admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.108915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.109741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.110051 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.110346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] PATH_INFO: `/v3/projects/f83a3ba6d3ad4f0ebd207164f83e59a6/users/1bc9a59ad61a4df0b8f12a428e3681c9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.124423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83a3ba6d3ad4f0ebd207164f83e59a6, user_id=1bc9a59ad61a4df0b8f12a428e3681c9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.127052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fbfb1-f70a-4bab-ade3-46b744ebc2f6 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.133689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1265/2547] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:24 2022] PUT /identity/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04/users/9fdc9d070946472c842a31c3ea585d6b/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:24.137987 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.200111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516b4b7-71f9-46f7-b1ab-8983d46d2dad admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.205023 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.205684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.205992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.206320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.206985 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.208070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1283/2548] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:24 2022] PUT /identity/v3/projects/f83a3ba6d3ad4f0ebd207164f83e59a6/users/1bc9a59ad61a4df0b8f12a428e3681c9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:24.216994 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.218562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.218855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.219139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.219557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1266/2549] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:24.223258 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.232752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ceefec-47c3-4789-944f-5fa7722a8d5b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.245182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] MFA Rules not processed for user `1bc9a59ad61a4df0b8f12a428e3681c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:24.246430 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:24.289166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.290086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.290365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.290640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] PATH_INFO: `/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04/users/9fdc9d070946472c842a31c3ea585d6b/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.292640 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff96e3e5cfc24ad0b35b8743453caf04, user_id=9fdc9d070946472c842a31c3ea585d6b, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.295319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1bf23-5b53-4592-9ed1-73bf993da1cd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.305818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1267/2550] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:24 2022] PUT /identity/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04/users/9fdc9d070946472c842a31c3ea585d6b/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:24.314272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1284/2551] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:24.318896 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.319417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.319708 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.319990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.328994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76ffde-8cde-4850-a5ed-3b79ae2633be None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.346501 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] MFA Rules not processed for user `9fdc9d070946472c842a31c3ea585d6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:24.347713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:24.366459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:24.390247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.390912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.391191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.391466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.392190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.394099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.417870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1268/2552] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:24.429653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.431084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:24.481500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1285/2553] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:24 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:24.485373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.487097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bb6f7-4be5-49cf-b9b5-57b30565cb4a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.495331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:24.537115 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.537768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.538080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.538356 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.547849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba77e1-9f68-4d92-9610-48221e67ada8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.553292 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.553976 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.554261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.554536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.555219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.557171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.599007 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.600426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.609280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1269/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:24.645564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1286/2555] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:24 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:24.649575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.663572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136e1bd-5384-4efa-b2b6-8244f120258a service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.668992 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.669676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.670021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.670295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.671025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.672652 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.685422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1270/2556] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:24.690660 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.702332 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fddef-16c7-4792-b064-c1fbd9d4cdad admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.708044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.709173 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.709602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.710060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] PATH_INFO: `/v3/projects/2a41bd2773514e449bacdbbc224c1d70/users/433a57cdb1a04d4292b196ca289627e9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.727936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a41bd2773514e449bacdbbc224c1d70, user_id=433a57cdb1a04d4292b196ca289627e9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.730882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.872231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1287/2557] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:24 2022] PUT /identity/v3/projects/2a41bd2773514e449bacdbbc224c1d70/users/433a57cdb1a04d4292b196ca289627e9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:24.872424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.881544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba936a57-f95d-43dc-b066-385bd674dcd8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.901880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:24.957983 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.969105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.969105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.969105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.969105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:24.969105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b162-90c7-43ee-a0ec-f8d4465cb51d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:24.971776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1271/2558] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:24.976993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:24.989239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124d6cc-da51-43f2-babb-1bdc0706db01 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:24.994404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:24.995512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:24.996532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:24.996532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] PATH_INFO: `/v3/projects/2a41bd2773514e449bacdbbc224c1d70/users/433a57cdb1a04d4292b196ca289627e9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:24.999152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a41bd2773514e449bacdbbc224c1d70, user_id=433a57cdb1a04d4292b196ca289627e9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:25.002128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:25.014217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1288/2559] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:24 2022] PUT /identity/v3/projects/2a41bd2773514e449bacdbbc224c1d70/users/433a57cdb1a04d4292b196ca289627e9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:25.025803 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:25.026260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:25.026613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:25.055842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] MFA Rules not processed for user `433a57cdb1a04d4292b196ca289627e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:25.057084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:25.134578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1272/2560] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:25.147166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:25.152752 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:25.209122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fdf5f-d0e0-48e2-98ad-8abc6cf98192 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:25.212881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:25.213531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:25.215778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:25.215778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:25.224002 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:25.225441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:25.235096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1289/2561] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:26.483952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:26.495593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad32491-8c79-49b9-b25b-110828a1fc5a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:26.499890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:26.500660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:26.501052 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:26.501423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:26.517027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:26.577213 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:26.578680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0caa0f-3fb1-4610-8759-ac522dc49ab3 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:26.579385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2b67f-54df-4c37-abcf-0b64ce4421fd service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:26.586259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:26.591555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:26.591555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:26.591555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] PATH_INFO: `/v3/users/1bc9a59ad61a4df0b8f12a428e3681c9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:26.591555 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bc9a59ad61a4df0b8f12a428e3681c9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:26.591939 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1273/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:26.592035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:26.596103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:26.780982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bc9a59ad61a4df0b8f12a428e3681c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:26.823421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bc9a59ad61a4df0b8f12a428e3681c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:26.926531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bc9a59ad61a4df0b8f12a428e3681c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:26.927146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bc9a59ad61a4df0b8f12a428e3681c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:26.935085 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bc9a59ad61a4df0b8f12a428e3681c9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:26.942479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1290/2563] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:26 2022] DELETE /identity/v3/users/1bc9a59ad61a4df0b8f12a428e3681c9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:26.947027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:26.947318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:26.947630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:26.965889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:26.967083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:26.994553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:27.030317 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1274/2564] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:27.039931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:27.041355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:27.102139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f490c8d-adb3-4667-b7e7-557028e23a2c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:27.106014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:27.106753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:27.107038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:27.107315 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:27.117125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:27.118644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:27.128844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1291/2565] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:27.551453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:27.556081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:27.567602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02973b03-8a91-4938-a053-8ec13a1a94cc None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:27.572878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:27.573770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:27.574152 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:27.574424 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] PATH_INFO: `/v3/projects/f83a3ba6d3ad4f0ebd207164f83e59a6` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:27.575810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83a3ba6d3ad4f0ebd207164f83e59a6)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:27.578086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:27.694665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83a3ba6d3ad4f0ebd207164f83e59a6', 'request_id': 'req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:27.703885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83a3ba6d3ad4f0ebd207164f83e59a6', 'request_id': 'req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:27.796559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83a3ba6d3ad4f0ebd207164f83e59a6', 'request_id': 'req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:27.809998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] The token cache is being invalidate because project f83a3ba6d3ad4f0ebd207164f83e59a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:27.810291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:27.811017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:27.812920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1275/2566] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:27 2022] DELETE /identity/v3/projects/f83a3ba6d3ad4f0ebd207164f83e59a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:27.817442 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:27.827260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821f8a2-f0f2-422e-a733-bf6d6dad058e service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:27.906253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:27.906253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:27.906253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:27.906253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] PATH_INFO: `/v3/users/433a57cdb1a04d4292b196ca289627e9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:27.906714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433a57cdb1a04d4292b196ca289627e9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:27.906714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:28.002496 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:28.116751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433a57cdb1a04d4292b196ca289627e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.128852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433a57cdb1a04d4292b196ca289627e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.220993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433a57cdb1a04d4292b196ca289627e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.221809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433a57cdb1a04d4292b196ca289627e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.234739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-472a27bc-e897-4040-ab88-7c153d27f074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433a57cdb1a04d4292b196ca289627e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.241748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1292/2567] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:27 2022] DELETE /identity/v3/users/433a57cdb1a04d4292b196ca289627e9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:28.648949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:28.650509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:28.663896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21a1c3-d3ac-463a-b7b6-94950fb22fda admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:28.722183 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:28.723056 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:28.723340 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:28.723663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] PATH_INFO: `/v3/projects/2a41bd2773514e449bacdbbc224c1d70` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:28.724842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a41bd2773514e449bacdbbc224c1d70)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:28.726797 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:28.851426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a41bd2773514e449bacdbbc224c1d70', 'request_id': 'req-08f38021-945e-440a-b7ae-825629ad3ce7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.856248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:28.857644 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a41bd2773514e449bacdbbc224c1d70', 'request_id': 'req-08f38021-945e-440a-b7ae-825629ad3ce7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.925345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a41bd2773514e449bacdbbc224c1d70', 'request_id': 'req-08f38021-945e-440a-b7ae-825629ad3ce7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.938003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] The token cache is being invalidate because project 2a41bd2773514e449bacdbbc224c1d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:28.938294 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.938925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-08f38021-945e-440a-b7ae-825629ad3ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:28.940457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1276/2568] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:28 2022] DELETE /identity/v3/projects/2a41bd2773514e449bacdbbc224c1d70 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:28.946067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:28.946520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:28.946612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:28.964738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:28.966037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:29.027189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1293/2569] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:29.035219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.035540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.035824 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.054512 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:29.055754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:29.063769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1277/2570] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:29.068548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.078415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61731aa-aeea-4640-aefa-c07fcd5322e9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.083061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.083703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.083985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.084264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.085009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:29.085334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.086967 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.098855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1294/2571] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:29.103162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.112252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a73b7-6158-478b-8a63-66100406786a None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.117414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.118096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.118381 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.118657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.119352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.121242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.219409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1278/2572] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:29.224283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.234536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5b897-84cb-49d7-8e62-b0cfc468e169 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.293078 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.293675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.293998 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.294340 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.295013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.297899 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.378014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1295/2573] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:29.382111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.392740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b762e9-1ac3-4a60-b578-f2abc356db11 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.397400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.398088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.401333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.401333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.401333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.401333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.411359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1279/2574] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:29.415244 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.425543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2a360-282e-480b-a1c3-e57eb9429682 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.430969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.431628 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.431909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.441369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.441369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.441369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8419c4-47c3-4e8f-ba06-6d386b97281e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.444912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1296/2575] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:29.449002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.459005 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd184e5-20e9-4534-8d10-289de892edf8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.463750 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.464622 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.464908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.465186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] PATH_INFO: `/v3/projects/1671b4eb1c664fbfa8c4ad2a56ee87b4/users/723d48a0ef2842ae98a11cf26b1214d8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.480485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1671b4eb1c664fbfa8c4ad2a56ee87b4, user_id=723d48a0ef2842ae98a11cf26b1214d8, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.483219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.542607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1280/2576] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:29 2022] PUT /identity/v3/projects/1671b4eb1c664fbfa8c4ad2a56ee87b4/users/723d48a0ef2842ae98a11cf26b1214d8/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:29.554768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.554996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.555277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.575311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:29.583444 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] MFA Rules not processed for user `723d48a0ef2842ae98a11cf26b1214d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:29.584643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:29.662477 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1297/2577] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:29.670237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.741155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0787a-1292-4135-a40b-575cf0afca15 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.745915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.746588 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.746952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.747235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.747923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.749810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.831380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1281/2578] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:29.835952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.847686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051e47b-194f-42c8-b2ec-b0cf7b886f0a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.906804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.907491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:29.907786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:29.908054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:29.908851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:29.911374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:29.979920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1298/2579] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:29 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:29.983955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:29.994557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db93f-b697-4e01-bd8c-b5b85243116c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:29.999283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:29.999991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.000658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.000658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.005290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:30.005290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:30.015176 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1282/2580] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:30.020174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:30.030712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e4cd8-f1da-4287-bd7c-08eb0a1f8667 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:30.035808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:30.036759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.037074 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.037526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] PATH_INFO: `/v3/projects/6e47ec0a026947c9ae91a49167c67649/users/4c9724e2c8c944c382349437f709b32a/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.053686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e47ec0a026947c9ae91a49167c67649, user_id=4c9724e2c8c944c382349437f709b32a, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:30.056593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:30.138411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1299/2581] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:30 2022] PUT /identity/v3/projects/6e47ec0a026947c9ae91a49167c67649/users/4c9724e2c8c944c382349437f709b32a/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:30.143072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:30.153244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef24bb2-63f6-4703-8afd-1f569aa2178a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:30.206408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:30.213230 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:30.213924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.214214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.214495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.215212 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:30.216884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c33d9-d221-4bca-9dc8-f340bbddd76a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:30.226955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1283/2582] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:30.231358 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:30.242374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea15deb-fc08-4c60-acd2-9c06a6761c87 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:30.247579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:30.248474 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.248801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.249080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] PATH_INFO: `/v3/projects/6e47ec0a026947c9ae91a49167c67649/users/4c9724e2c8c944c382349437f709b32a/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.251088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e47ec0a026947c9ae91a49167c67649, user_id=4c9724e2c8c944c382349437f709b32a, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:30.257072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:30.265023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1300/2583] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:30 2022] PUT /identity/v3/projects/6e47ec0a026947c9ae91a49167c67649/users/4c9724e2c8c944c382349437f709b32a/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:30.275366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.275661 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.275945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.302582 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] MFA Rules not processed for user `4c9724e2c8c944c382349437f709b32a`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:30.303795 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:30.372897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1284/2584] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:30.384458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:30.386176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:30.443512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358f5c2-c487-4265-8983-8cf225355b68 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:30.447304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:30.447936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:30.448218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:30.448498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:30.453751 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:30.505268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:30.506892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f697fae-77ac-4876-9e0d-819a892d1119 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:30.516763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1301/2585] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:31.010719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:31.012126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:31.077175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59223d4-212e-4ca6-b873-2b8598460112 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:31.081952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:31.083361 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:31.083643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:31.083916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] PATH_INFO: `/v3/users/d4492c271e404708ae68553dc4dc6010` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:31.085131 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4492c271e404708ae68553dc4dc6010)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:31.087113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:31.272118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4492c271e404708ae68553dc4dc6010'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:31.284455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4492c271e404708ae68553dc4dc6010'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:31.291463 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4492c271e404708ae68553dc4dc6010'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:31.292259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4492c271e404708ae68553dc4dc6010'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:31.292988 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4492c271e404708ae68553dc4dc6010'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:31.297047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:31.355881 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1285/2586] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:31 2022] DELETE /identity/v3/users/d4492c271e404708ae68553dc4dc6010 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:31.360355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:31.360786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:31.360950 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:31.379568 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:31.380834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:31.442381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1302/2587] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:31.456599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:31.456599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:31.510392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631b359-4bc7-4d2c-b550-c019d81ee9b4 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:31.514410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:31.515068 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:31.515353 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:31.515632 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:31.525330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:31.528384 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:31.536558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1286/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:31.957516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:31.959162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:31.973354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73c02b-09ab-46ae-aec4-52150072a30f None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:31.978238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:31.982821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:31.982821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:31.982821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] PATH_INFO: `/v3/projects/8395b006fa8449c6ac3ba0a45c086a9e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:31.982821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8395b006fa8449c6ac3ba0a45c086a9e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:31.983322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:32.115515 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8395b006fa8449c6ac3ba0a45c086a9e', 'request_id': 'req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.121890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8395b006fa8449c6ac3ba0a45c086a9e', 'request_id': 'req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.199615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8395b006fa8449c6ac3ba0a45c086a9e', 'request_id': 'req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.211087 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] The token cache is being invalidate because project 8395b006fa8449c6ac3ba0a45c086a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:32.215109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.215109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.215109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1303/2589] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:31 2022] DELETE /identity/v3/projects/8395b006fa8449c6ac3ba0a45c086a9e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:32.217455 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:32.228163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a40a2dc-c0b3-4833-b60b-9c1ba14e1ac1 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:32.296464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:32.297332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:32.297611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:32.297915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] PATH_INFO: `/v3/users/9fdc9d070946472c842a31c3ea585d6b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:32.299189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fdc9d070946472c842a31c3ea585d6b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:32.301186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:32.526532 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fdc9d070946472c842a31c3ea585d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.542557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fdc9d070946472c842a31c3ea585d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.550079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fdc9d070946472c842a31c3ea585d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.551687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fdc9d070946472c842a31c3ea585d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.552301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-f28e22df-e00e-4c37-aa08-b70425a8dc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fdc9d070946472c842a31c3ea585d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:32.630922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1287/2590] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:32 2022] DELETE /identity/v3/users/9fdc9d070946472c842a31c3ea585d6b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:33.088973 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.091665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:33.107228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb9494-a35d-4ef2-9e9a-44f310dd5382 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.140616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:33.170539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.171465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.171745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.172018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] PATH_INFO: `/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.173206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff96e3e5cfc24ad0b35b8743453caf04)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.175685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.300200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff96e3e5cfc24ad0b35b8743453caf04', 'request_id': 'req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:33.306855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff96e3e5cfc24ad0b35b8743453caf04', 'request_id': 'req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:33.366536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff96e3e5cfc24ad0b35b8743453caf04', 'request_id': 'req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:33.377541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] The token cache is being invalidate because project ff96e3e5cfc24ad0b35b8743453caf04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:33.377831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:33.378485 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-ad8960ca-2a87-4dcf-aa5a-4825f3c1f81b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:33.380679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1304/2591] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:33 2022] DELETE /identity/v3/projects/ff96e3e5cfc24ad0b35b8743453caf04 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:33.385812 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.386290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.386398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.404521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:33.405779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:33.417761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:33.466075 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1288/2592] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:33.475627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.475940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.476220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.495010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:33.496774 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:33.505225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1305/2593] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:33.509683 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.520590 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc85c84-939e-431a-b9f9-9c69e213e53b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.525785 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.526484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.526770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.527050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.527882 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:33.528062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.529711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.545627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1289/2594] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:33.546867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.556464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06f991-19b5-4607-80cf-335b9726107a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.561308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.562129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.562417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.562695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.563434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.565316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.654093 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1306/2595] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:33 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:33.659352 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.670024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70718d-a346-4bc7-9dc7-2eca93adf0e6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.725654 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.726376 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.726662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.726938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.727635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.729547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.885391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1290/2596] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:33 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:33.885994 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.897027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bd516-78ff-4c25-9ab6-a53d4b387b17 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.901791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.903864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.903864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.903864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.904148 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.905647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.918768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1307/2597] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:33.922943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.933282 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6349412c-908f-48ea-bc98-eb746f3cb2da admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.938036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.938689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.938968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.939242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.939957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.942191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018f42-2a4c-47fc-9c5b-e64ca31597f1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:33.952490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1291/2598] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:33.956659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:33.968420 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0abd3-0623-410e-ba7f-21897804e9f9 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:33.977946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:33.978833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:33.979117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:33.979390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] PATH_INFO: `/v3/projects/a730383cc4f7469e84223977ab7728f3/users/2470474ce1344cc48adf40b84ff89b78/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:33.998881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a730383cc4f7469e84223977ab7728f3, user_id=2470474ce1344cc48adf40b84ff89b78, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:33.998881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.090939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1308/2599] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:33 2022] PUT /identity/v3/projects/a730383cc4f7469e84223977ab7728f3/users/2470474ce1344cc48adf40b84ff89b78/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:34.105388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.105388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.105388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.129831 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] MFA Rules not processed for user `2470474ce1344cc48adf40b84ff89b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:34.131102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:34.195473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1292/2600] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:34.200027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.258050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:34.261840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030526be-f6ee-40d9-a854-327245b8eeef admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.266615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.267268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.267549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.267822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.268514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.271800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.361584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1309/2601] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:34 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:34.363101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.373875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000faf84-550c-41a5-a02c-fb3dd047f9a3 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.382924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:34.430167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.430814 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.431081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.431420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.432114 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.434037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.532847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1293/2602] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:34 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:34.538724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.549686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a18d4-6141-422b-96df-89fe178260d9 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.555048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.555716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.556028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.556305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.557032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.558726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.570384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1310/2603] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:34.574743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.587321 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2694-6b1c-45a2-9bb1-c11f0295c55e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.592140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.593024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.593305 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.593577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] PATH_INFO: `/v3/projects/57c9e337e9ff4582880889fca49924de/users/ed75d199501244a08b5893f952ef703f/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.608930 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c9e337e9ff4582880889fca49924de, user_id=ed75d199501244a08b5893f952ef703f, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.611664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.677074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1294/2604] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:34 2022] PUT /identity/v3/projects/57c9e337e9ff4582880889fca49924de/users/ed75d199501244a08b5893f952ef703f/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:34.681110 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.691777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a2825-332a-4dbd-a78b-6a8d1a45a87f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.750045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.750671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.750945 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.751221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.751971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.753597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4de65-8fbe-44a4-8a96-de2a6580ee77 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.765406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1311/2605] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:34.770195 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.775727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.776019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.778049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.781667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f1c4f-5f76-4fc4-a350-7ffa383eb8af admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.786521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:34.787471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.787853 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.788243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] PATH_INFO: `/v3/projects/57c9e337e9ff4582880889fca49924de/users/ed75d199501244a08b5893f952ef703f/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.790411 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c9e337e9ff4582880889fca49924de, user_id=ed75d199501244a08b5893f952ef703f, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:34.793091 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df9f5ae-a3a3-4b07-8a2a-00d6f04c8b74 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:34.794069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:34.795267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:34.803941 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1295/2606] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:34 2022] PUT /identity/v3/projects/57c9e337e9ff4582880889fca49924de/users/ed75d199501244a08b5893f952ef703f/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:34.815293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:34.815696 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:34.815980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:34.844370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] MFA Rules not processed for user `ed75d199501244a08b5893f952ef703f`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:34.845594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:34.856300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1312/2607] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:34.880192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.881377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:34.920740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1296/2608] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:34.932749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:34.934308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:34.956258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a322aa-ade6-4ed6-8d00-a930d77db77a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.968649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:34.995629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f6303-94e8-48c9-9167-6e0864570d8e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:34.999695 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:35.000634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.001343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.001343 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.007378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:35.011329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:35.012796 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:35.023643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1297/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:35.028858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:35.029509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.030321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.030321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.091348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:35.092980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e56e2f-86ff-4566-b773-540baa3aeafa service swift] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:35.102132 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1313/2610] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:55:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 03:55:35.164873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:35.227810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb571385-d84d-44b7-954d-faf56edc5956 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:35.232607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:35.239586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.239586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.239586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] PATH_INFO: `/v3/users/2470474ce1344cc48adf40b84ff89b78` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.239586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2470474ce1344cc48adf40b84ff89b78)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:35.239586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:35.431762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2470474ce1344cc48adf40b84ff89b78'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:35.444147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2470474ce1344cc48adf40b84ff89b78'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:35.451119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2470474ce1344cc48adf40b84ff89b78'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:35.451851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2470474ce1344cc48adf40b84ff89b78'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:35.452458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2470474ce1344cc48adf40b84ff89b78'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:35.521112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1298/2611] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:35 2022] DELETE /identity/v3/users/2470474ce1344cc48adf40b84ff89b78 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:35.525654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.525978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.526289 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.543917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:35.545113 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:35.605780 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1314/2612] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:35.615716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:35.617277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:35.677553 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77543-125a-40c0-8ae2-7d44d48cbfe8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:35.685452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:35.685452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.685452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.685452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.695096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:35.696602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:35.708025 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1299/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:35.709260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:35.710791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:35.772035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2767-9a8e-4f1e-8d3b-51e7f416e1da None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:35.775733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:35.776381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:35.776932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:35.777121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:35.778947 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:35.789475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:35.845750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:35.847221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:35.857467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1315/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:36.099966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:36.101866 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:36.122966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ebf10-e098-40af-a5a8-aafb3804fd0f service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:36.131637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:36.132572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:36.132818 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:36.133095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] PATH_INFO: `/v3/projects/a730383cc4f7469e84223977ab7728f3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:36.134658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a730383cc4f7469e84223977ab7728f3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:36.136755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:36.152221 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:36.287400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a730383cc4f7469e84223977ab7728f3', 'request_id': 'req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.293316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a730383cc4f7469e84223977ab7728f3', 'request_id': 'req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.388299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a730383cc4f7469e84223977ab7728f3', 'request_id': 'req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.410193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] The token cache is being invalidate because project a730383cc4f7469e84223977ab7728f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:36.410486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.412465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.414351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1300/2615] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:36 2022] DELETE /identity/v3/projects/a730383cc4f7469e84223977ab7728f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:36.418532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:36.430130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c21b6dc-0938-4196-9842-fbaa33b27597 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:36.489012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:36.490012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:36.490419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:36.490701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] PATH_INFO: `/v3/users/ed75d199501244a08b5893f952ef703f` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:36.491892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed75d199501244a08b5893f952ef703f)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:36.493786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:36.692820 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed75d199501244a08b5893f952ef703f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.724678 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed75d199501244a08b5893f952ef703f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.806735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed75d199501244a08b5893f952ef703f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.807460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed75d199501244a08b5893f952ef703f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.815482 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-4ca97a16-c207-4eac-9dac-029141d6cbeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed75d199501244a08b5893f952ef703f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:36.822165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1316/2616] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:36 2022] DELETE /identity/v3/users/ed75d199501244a08b5893f952ef703f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:37.236208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:37.236208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:37.252246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758d204-7ea3-4ec0-b7b4-b6bb0830cfe7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:37.333568 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:37.334819 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.339339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.339339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] PATH_INFO: `/v3/projects/57c9e337e9ff4582880889fca49924de` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.339339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c9e337e9ff4582880889fca49924de)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:37.339726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:37.435557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c9e337e9ff4582880889fca49924de', 'request_id': 'req-90a10892-4d1e-4543-a81e-2956337aae0c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:37.441333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c9e337e9ff4582880889fca49924de', 'request_id': 'req-90a10892-4d1e-4543-a81e-2956337aae0c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:37.509817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c9e337e9ff4582880889fca49924de', 'request_id': 'req-90a10892-4d1e-4543-a81e-2956337aae0c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:37.522514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] The token cache is being invalidate because project 57c9e337e9ff4582880889fca49924de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:37.522802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:37.523474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-90a10892-4d1e-4543-a81e-2956337aae0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:37.525061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1301/2617] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:37 2022] DELETE /identity/v3/projects/57c9e337e9ff4582880889fca49924de => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:37.530009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.530460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.530576 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.548264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:37.549464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:37.571267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:37.611979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1317/2618] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:37.619800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.620116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.620397 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.640178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:37.641420 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:37.652462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1302/2619] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:37.655577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:37.667400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99cde9-133b-40c0-9566-50509a756190 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:37.672398 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:37.673069 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.673356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.673714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.674419 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:37.674729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:37.677117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:37.693986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1318/2620] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:37.695359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:37.711673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b756-26fc-45b1-bf70-f5652c8c410b None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:37.718856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:37.721031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.721031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.721031 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.722908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:37.725515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:37.837727 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:37.846911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1303/2621] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:37.854028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:37.867531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4ec4e-2887-4127-9072-586aaf04e94a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:37.937686 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:37.938396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:37.938685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:37.938966 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:37.939659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:37.941652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:38.061257 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1319/2622] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:37 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:38.062534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:38.073436 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a650f2-6775-45a0-a351-f5d43b7f22d3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:38.079000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:38.079788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:38.080081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:38.080464 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:38.081104 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:38.083370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:38.099129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1304/2623] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:38.107114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:38.119582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a33663-dd99-4893-a3bb-5ab53a693f48 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:38.124685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:38.125427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:38.125778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:38.126103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:38.126946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:38.129365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d82a3e-316c-426c-a2eb-2ed566c6ceb2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:38.142233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1320/2624] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:38.148440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:38.159159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499937a-35a0-4887-b492-1e0b6f4b45e2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:38.165793 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:38.166759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:38.167094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:38.168365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] PATH_INFO: `/v3/projects/d30a65f31afa420cbaa03b46c469a2e3/users/1ce3858837d446baa660dc58c2b3ea8c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:38.185124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30a65f31afa420cbaa03b46c469a2e3, user_id=1ce3858837d446baa660dc58c2b3ea8c, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:38.188348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:38.318037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1305/2625] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:38 2022] PUT /identity/v3/projects/d30a65f31afa420cbaa03b46c469a2e3/users/1ce3858837d446baa660dc58c2b3ea8c/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:38.322977 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187d65-9f39-4d8a-b5a1-54254fc14b09 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:38.323309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187d65-9f39-4d8a-b5a1-54254fc14b09 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:38.323572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d187d65-9f39-4d8a-b5a1-54254fc14b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:38.342096 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-8d187d65-9f39-4d8a-b5a1-54254fc14b09 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:38.343299 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-8d187d65-9f39-4d8a-b5a1-54254fc14b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:38.403437 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1321/2626] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:38.413009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:38.414723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:38.473513 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2c790-4398-432d-b728-be3ed1a4a168 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:38.477140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:38.477801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:38.478109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:38.478393 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:38.501975 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:38.504405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:38.517159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1306/2627] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:40.652873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:40.653903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:40.654271 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:40.688731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] MFA Rules not processed for user `1ce3858837d446baa660dc58c2b3ea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:40.691415 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:40.731733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:40.779779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1322/2628] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:40.784639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:40.796333 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49253e2-062e-41e7-8e64-97915063be95 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:40.801628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:40.802306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:40.802589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:40.802862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:40.803566 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:40.805546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:40.926541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1307/2629] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:40 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:40.927905 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:40.938927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec113-5a85-4c00-9622-d9d7735fa323 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:41.006993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:41.007687 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:41.007982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:41.008265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:41.009440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:41.011399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:41.102318 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1323/2630] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:40 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:41.103542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:41.114844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b226b4f-821e-42b4-bcc8-6660a15aca16 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:41.119665 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:41.120354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:41.120645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:41.120928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:41.121674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:41.123335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:41.135539 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1308/2631] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:41.140014 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:41.151789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24996-038e-4a2b-b8c6-cfa57df87caa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:41.157019 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:41.158045 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:41.158350 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:41.158633 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] PATH_INFO: `/v3/projects/e247d6ea61d6448b9f2082e53ac4d091/users/bdffd39da0b34fcbaad5ed26adaaef9c/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:41.176134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e247d6ea61d6448b9f2082e53ac4d091, user_id=bdffd39da0b34fcbaad5ed26adaaef9c, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:41.180756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:41.275643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1324/2632] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:41 2022] PUT /identity/v3/projects/e247d6ea61d6448b9f2082e53ac4d091/users/bdffd39da0b34fcbaad5ed26adaaef9c/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:41.279675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:41.290404 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacbc40e-8414-48d3-80c7-b094fb3e0dc7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:41.349245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:41.350070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:41.350244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:41.350526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:41.351266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:41.352895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:41.365605 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1309/2633] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:55:41.372725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:41.384186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f9149-f1eb-4c5f-a5b5-cd11e9327756 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:41.389088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:41.390031 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:41.390316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:41.390594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] PATH_INFO: `/v3/projects/e247d6ea61d6448b9f2082e53ac4d091/users/bdffd39da0b34fcbaad5ed26adaaef9c/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:41.392650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e247d6ea61d6448b9f2082e53ac4d091, user_id=bdffd39da0b34fcbaad5ed26adaaef9c, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:41.395938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d41-4baa-4158-acee-f619c821c6f2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:41.407927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1325/2634] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:41 2022] PUT /identity/v3/projects/e247d6ea61d6448b9f2082e53ac4d091/users/bdffd39da0b34fcbaad5ed26adaaef9c/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:42.079094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:42.081093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:42.093917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4d437-15f8-4f3d-a496-d6f44f4fa655 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:42.126383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:42.156519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:42.157707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:42.158026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:42.158310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] PATH_INFO: `/v3/users/723d48a0ef2842ae98a11cf26b1214d8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:42.159646 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723d48a0ef2842ae98a11cf26b1214d8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:42.162396 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:42.348662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723d48a0ef2842ae98a11cf26b1214d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:42.363227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723d48a0ef2842ae98a11cf26b1214d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:42.372929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723d48a0ef2842ae98a11cf26b1214d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:42.376047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723d48a0ef2842ae98a11cf26b1214d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:42.377475 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723d48a0ef2842ae98a11cf26b1214d8'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:42.480867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1310/2635] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:42 2022] DELETE /identity/v3/users/723d48a0ef2842ae98a11cf26b1214d8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:42.485491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e1a1-52e3-469b-8003-00782e8e5325 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:42.486099 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e1a1-52e3-469b-8003-00782e8e5325 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:42.486203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765e1a1-52e3-469b-8003-00782e8e5325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:42.506076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3765e1a1-52e3-469b-8003-00782e8e5325 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:42.514125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3765e1a1-52e3-469b-8003-00782e8e5325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:42.574259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1326/2636] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:42.584387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:42.585842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:42.669119 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505a1bb-3812-4cce-99a2-d75a11a23a52 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:42.675710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:42.676456 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:42.676991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:42.683691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:42.694038 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:42.695779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82000c46-a7a4-4f5a-9c84-298665f244e5 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:42.722454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1311/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:42.811778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:42.812065 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:42.812344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:42.854479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] MFA Rules not processed for user `bdffd39da0b34fcbaad5ed26adaaef9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:42.855755 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:42.861126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:42.960359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1327/2638] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:42.962097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:42.962399 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:42.962682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:42.988457 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] MFA Rules not processed for user `1ce3858837d446baa660dc58c2b3ea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:42.990047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:43.056792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:43.072225 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1312/2639] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:43.085525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:43.087711 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:43.191593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719da9-8160-43ee-8481-ca4adabc88dd None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:43.197168 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:43.197817 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:43.198128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:43.201873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:43.201873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:43.210915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:43.212673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:43.222939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1328/2640] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:43.277645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:43.277645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:43.291301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76681186-824b-42ba-a5e4-75059a29c9d8 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:43.299642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:43.310739 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:43.311130 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:43.312073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] PATH_INFO: `/v3/projects/1671b4eb1c664fbfa8c4ad2a56ee87b4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:43.314526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=1671b4eb1c664fbfa8c4ad2a56ee87b4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:43.320552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:43.439126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1671b4eb1c664fbfa8c4ad2a56ee87b4', 'request_id': 'req-c5bc34b1-c129-495d-899a-aad1ab210aba'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.449662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1671b4eb1c664fbfa8c4ad2a56ee87b4', 'request_id': 'req-c5bc34b1-c129-495d-899a-aad1ab210aba'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.571096 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1671b4eb1c664fbfa8c4ad2a56ee87b4', 'request_id': 'req-c5bc34b1-c129-495d-899a-aad1ab210aba'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.585482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] The token cache is being invalidate because project 1671b4eb1c664fbfa8c4ad2a56ee87b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:43.585773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.586541 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.588206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1313/2641] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:43 2022] DELETE /identity/v3/projects/1671b4eb1c664fbfa8c4ad2a56ee87b4 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:43.592259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:43.605833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bb30c-dfd3-4c8b-aef5-c5ddfdbb71d6 service nova] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:43.690727 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:43.692331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:43.692750 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:43.693075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] PATH_INFO: `/v3/users/4c9724e2c8c944c382349437f709b32a` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:43.695390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9724e2c8c944c382349437f709b32a)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:43.696561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:43.860150 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:43.966155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9724e2c8c944c382349437f709b32a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:43.991550 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9724e2c8c944c382349437f709b32a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.086404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9724e2c8c944c382349437f709b32a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.087029 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9724e2c8c944c382349437f709b32a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.094970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9724e2c8c944c382349437f709b32a'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.100952 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1329/2642] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:43 2022] DELETE /identity/v3/users/4c9724e2c8c944c382349437f709b32a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:44.471945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:44.474094 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:44.489443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc34b1-c129-495d-899a-aad1ab210aba admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:44.555718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:44.556583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:44.556865 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:44.557140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] PATH_INFO: `/v3/users/b440619aac564c94b798b53601d6567a` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:44.558331 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b440619aac564c94b798b53601d6567a)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:44.560298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:44.597471 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:44.600525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:44.616410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec450f-c6cb-4ce1-a657-b170139d494a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:44.622310 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:44.622554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:44.622948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:44.623214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] PATH_INFO: `/v3/projects/6e47ec0a026947c9ae91a49167c67649` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:44.624402 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e47ec0a026947c9ae91a49167c67649)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:44.626389 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:44.803721 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e47ec0a026947c9ae91a49167c67649', 'request_id': 'req-156f1312-f1e0-4bad-a443-04f3f75e3a4f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.803883 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b440619aac564c94b798b53601d6567a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.810129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e47ec0a026947c9ae91a49167c67649', 'request_id': 'req-156f1312-f1e0-4bad-a443-04f3f75e3a4f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.816434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b440619aac564c94b798b53601d6567a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.823351 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b440619aac564c94b798b53601d6567a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.824106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b440619aac564c94b798b53601d6567a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.824715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-45d63fab-aac6-47c8-90e2-cd3452f370ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b440619aac564c94b798b53601d6567a'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.967673 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e47ec0a026947c9ae91a49167c67649', 'request_id': 'req-156f1312-f1e0-4bad-a443-04f3f75e3a4f'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.979627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] The token cache is being invalidate because project 6e47ec0a026947c9ae91a49167c67649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:44.979920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.980572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-156f1312-f1e0-4bad-a443-04f3f75e3a4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:44.982235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1330/2643] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:44 2022] DELETE /identity/v3/projects/6e47ec0a026947c9ae91a49167c67649 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:44.987932 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:44.988220 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:44.988501 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.007553 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:45.008791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.036973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:45.042417 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1314/2644] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:44 2022] DELETE /identity/v3/users/b440619aac564c94b798b53601d6567a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:45.078356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1331/2645] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:45.087735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.088027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.088307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.107749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:45.109526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.174580 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1315/2646] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:45.178650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.189214 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec4928-fb26-48b1-ad6a-f969368211c9 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.195840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.196539 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.196824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.197103 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.197873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:55:45.198223 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.199907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.215892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1332/2647] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:55:45.218362 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.227977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d4200-265e-447c-841e-80afcadf8fa1 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.232779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.233433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.233749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.234070 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.234766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.236655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.328809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.333592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1316/2648] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:55:45 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:55:45.334581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.335107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.349779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a01659-e97b-422d-85a9-b567fce16d1f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.363405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:45.412272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.413230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.413618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.414025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] PATH_INFO: `/v3/projects/b48edf25eb724491836a7a5cbf73d595` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.415317 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48edf25eb724491836a7a5cbf73d595)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.417335 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.423905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5374e8-7bd7-416c-b9ac-081e3cb2657e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.428980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.429639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.429949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.430227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.430947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.432839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.533120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1317/2649] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:55:45 2022] POST /identity/v3/users => generated 286 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:55:45.537837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.547327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f72572-36d4-4c1b-820d-2d4accdbdb32 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.552093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.552758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.553044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.553318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.554081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.555655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.565938 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1318/2650] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:45.569537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.575490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48edf25eb724491836a7a5cbf73d595', 'request_id': 'req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.579061 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28ec7-ce12-42d1-b40f-a9f169c5c1ec admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.582327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48edf25eb724491836a7a5cbf73d595', 'request_id': 'req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.635415 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:45.641261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.641956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.642241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.642516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.643226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.645324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.654758 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1319/2651] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:55:45.658830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.668211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15202d31-af54-46d5-b928-b26a885230ad admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.672784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.673627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.673916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.674199 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] PATH_INFO: `/v3/projects/aa804261a02848f98d5b9fb27c9eada3/users/d1a236e9354d4b63840ae1d0907cac79/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.676080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48edf25eb724491836a7a5cbf73d595', 'request_id': 'req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.689639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa804261a02848f98d5b9fb27c9eada3, user_id=d1a236e9354d4b63840ae1d0907cac79, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.690166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] The token cache is being invalidate because project b48edf25eb724491836a7a5cbf73d595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:45.690512 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.691287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.692345 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485525a-e7ff-4576-807e-d2e6c0108039 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.693152 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1333/2652] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:45 2022] DELETE /identity/v3/projects/b48edf25eb724491836a7a5cbf73d595 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:45.697283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.698618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.711929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb6f77-6d4c-436b-a396-3e5d6fcd7340 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.716898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.717767 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.718086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.718405 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] PATH_INFO: `/v3/users/919408418ef546e48a27a8c1e2534cb3` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.719615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=919408418ef546e48a27a8c1e2534cb3)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.721525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.789731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1320/2653] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:55:45 2022] PUT /identity/v3/projects/aa804261a02848f98d5b9fb27c9eada3/users/d1a236e9354d4b63840ae1d0907cac79/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:45.794595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.794886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.795165 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.812188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:45.813407 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.872784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1321/2654] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:45.883037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:45.887642 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:45.943041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c272e8-f94b-4c7e-a88d-c29379f2dbe0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:45.948560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:45.948560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:45.948560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:45.948560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:45.957118 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:45.958603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:45.968458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1322/2655] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:55:45.983165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '919408418ef546e48a27a8c1e2534cb3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:45.996491 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '919408418ef546e48a27a8c1e2534cb3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.102662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '919408418ef546e48a27a8c1e2534cb3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.103297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '919408418ef546e48a27a8c1e2534cb3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.114428 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-50ae7739-3822-41d2-9588-58ff664d9973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '919408418ef546e48a27a8c1e2534cb3'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.127452 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1334/2656] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:55:45 2022] DELETE /identity/v3/users/919408418ef546e48a27a8c1e2534cb3 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:55:46.601655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:46.612120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafc29-0de4-4c24-9dde-54f85e63e86b service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:46.694093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:46.694960 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:46.695295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:46.695578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] PATH_INFO: `/v3/projects/54b8b055a7d3481ba987db689ccaf433` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:46.696763 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b8b055a7d3481ba987db689ccaf433)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:46.698681 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:46.715718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:46.829949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b8b055a7d3481ba987db689ccaf433', 'request_id': 'req-d04de504-6c19-46ee-a8b1-c9824789f11e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.836082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b8b055a7d3481ba987db689ccaf433', 'request_id': 'req-d04de504-6c19-46ee-a8b1-c9824789f11e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.909084 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b8b055a7d3481ba987db689ccaf433', 'request_id': 'req-d04de504-6c19-46ee-a8b1-c9824789f11e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.921014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] The token cache is being invalidate because project 54b8b055a7d3481ba987db689ccaf433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:55:46.921296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.921968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:55:46.923552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1323/2657] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:55:46 2022] DELETE /identity/v3/projects/54b8b055a7d3481ba987db689ccaf433 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:55:47.706286 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8942-d185-4146-8bb5-a3e9290d7c74 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:47.707309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8942-d185-4146-8bb5-a3e9290d7c74 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:47.707409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be8942-d185-4146-8bb5-a3e9290d7c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:47.735457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-90be8942-d185-4146-8bb5-a3e9290d7c74 None None] MFA Rules not processed for user `d1a236e9354d4b63840ae1d0907cac79`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:47.736792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-90be8942-d185-4146-8bb5-a3e9290d7c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:47.741951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:47.808514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1335/2658] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:55:47.819191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:55:47.820648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:47.881738 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04de504-6c19-46ee-a8b1-c9824789f11e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:55:47.885707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:55:47.886410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:47.892088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:47.892088 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:47.896050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:55:47.897496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:55:47.907162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1324/2659] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:55:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:55:49.585681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:55:49.586698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:55:49.586980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:55:49.605108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] MFA Rules not processed for user `d1a236e9354d4b63840ae1d0907cac79`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:55:49.606353 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:55:49.614184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1336/2660] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:55:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:55:57.903077 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:55:59.599659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=27 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:00.566469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:00.567895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:00.627676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0d556-84c3-4902-92c4-d3ed289532d3 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:00.631350 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:00.631993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:00.632274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:00.632549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:00.634594 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:00.704676 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:00.706657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:00.717573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1325/2661] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:02.500385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:02.501837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:02.514605 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7c497-b067-42a5-9183-afd5fd0e69b3 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:02.518239 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:02.519432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:02.519712 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:02.520255 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:02.522232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:02.585842 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:02.587327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e0ab2-29e1-4f5e-8419-3dbed2a5a5b2 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:02.597104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1337/2662] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:03.076229 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:03.084925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc126-2fe2-4060-ba60-5d62ff71daba service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:03.088767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:03.089419 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:03.089704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:03.090021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:03.091808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:03.110161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:03.112851 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:03.124702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1326/2663] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:10.126072 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:10.126567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:10.126676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:10.144742 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] MFA Rules not processed for user `d1a236e9354d4b63840ae1d0907cac79`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:10.145995 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:10.153217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1338/2664] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:13.119838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=60 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:20.139316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=33 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:24.040290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:24.041933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:24.053597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb33e6-3f68-4ec3-91fa-92f553292505 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:24.057357 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:24.064319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:24.064319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:24.064319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:24.064319 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:24.123178 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:24.124616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:24.134728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1327/2665] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:28.146805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:28.148573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:28.220740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837ff60-ca4a-4924-86fd-2acc3eb79ba7 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:28.225722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:28.226404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:28.226694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:28.226972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:28.228806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:28.241493 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:28.243115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:28.253308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1339/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:28.288912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:28.291382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:28.307410 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48391ea4-94c4-484a-bd47-ad298dcf8a96 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:28.314269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:28.315027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:28.315307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:28.315578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] PATH_INFO: `/v3/users/f0d12edb8e754ddb9578226105d4fa6d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:28.333933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d12edb8e754ddb9578226105d4fa6d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:28.337057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:28.545168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d12edb8e754ddb9578226105d4fa6d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:28.561211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d12edb8e754ddb9578226105d4fa6d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:28.568522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d12edb8e754ddb9578226105d4fa6d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:28.569260 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d12edb8e754ddb9578226105d4fa6d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:28.570024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d12edb8e754ddb9578226105d4fa6d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:28.652575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1328/2667] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:28 2022] DELETE /identity/v3/users/f0d12edb8e754ddb9578226105d4fa6d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:28.691219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:28.694129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:28.708269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0388e-fee4-4cbf-8807-209ce6eb8ad6 service placement] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:28.791440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:28.792347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:28.792630 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:28.792908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] PATH_INFO: `/v3/users/1ce3858837d446baa660dc58c2b3ea8c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:28.798969 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce3858837d446baa660dc58c2b3ea8c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:28.803374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:28.983715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:28.985215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.002487 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46bae1-28db-4db0-91ce-25a67f3908e3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.007295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.009274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.009274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.009274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] PATH_INFO: `/v3/projects/60ad914d35bd44b2b15f0c420d5fb878` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.022694 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ad914d35bd44b2b15f0c420d5fb878)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.024687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.029644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce3858837d446baa660dc58c2b3ea8c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.043545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce3858837d446baa660dc58c2b3ea8c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.141431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce3858837d446baa660dc58c2b3ea8c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.142080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce3858837d446baa660dc58c2b3ea8c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.151578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1a1ecc4c-7b68-4e77-b380-7a39c5d85573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce3858837d446baa660dc58c2b3ea8c'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.158597 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1340/2668] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:28 2022] DELETE /identity/v3/users/1ce3858837d446baa660dc58c2b3ea8c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:29.165452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:29.171706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ad914d35bd44b2b15f0c420d5fb878', 'request_id': 'req-eb36c88c-d536-4915-91a9-77797b5b46d1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.177378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ad914d35bd44b2b15f0c420d5fb878', 'request_id': 'req-eb36c88c-d536-4915-91a9-77797b5b46d1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.238414 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ad914d35bd44b2b15f0c420d5fb878', 'request_id': 'req-eb36c88c-d536-4915-91a9-77797b5b46d1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.250360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] The token cache is being invalidate because project 60ad914d35bd44b2b15f0c420d5fb878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:29.250709 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.251398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eb36c88c-d536-4915-91a9-77797b5b46d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.253030 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1329/2669] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:28 2022] DELETE /identity/v3/projects/60ad914d35bd44b2b15f0c420d5fb878 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:29.258912 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.259205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.259783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.277978 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:29.279203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.283881 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:29.345460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1341/2670] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:29.354134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.354615 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.354741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.372990 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:29.374240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.383113 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1330/2671] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:29.387670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.398003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b61be0-4de9-4de4-8ec5-448895c17396 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.402593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.403235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.403517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.403826 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.404548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:29.404854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.406514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.413318 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.415289 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.419585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1342/2672] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:29.425959 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.432822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f81562-12be-4eea-bf3a-57508b7c3ae0 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.438433 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2558-91e5-4789-b668-917bdcd76036 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.444738 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.445053 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.445155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.445381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.446060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.447146 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.447953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.448645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.449367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.449367 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] PATH_INFO: `/v3/projects/d30a65f31afa420cbaa03b46c469a2e3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.450577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30a65f31afa420cbaa03b46c469a2e3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.452530 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.522939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1343/2673] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:29 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:29.526783 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.584445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30a65f31afa420cbaa03b46c469a2e3', 'request_id': 'req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.587233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd8236-9a12-4aa4-a542-624f96c1ab47 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.589808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30a65f31afa420cbaa03b46c469a2e3', 'request_id': 'req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.646829 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.647508 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.647793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.648070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.648796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.650747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.657316 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30a65f31afa420cbaa03b46c469a2e3', 'request_id': 'req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.670971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] The token cache is being invalidate because project d30a65f31afa420cbaa03b46c469a2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:29.671257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.671965 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.673623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1331/2674] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:29 2022] DELETE /identity/v3/projects/d30a65f31afa420cbaa03b46c469a2e3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:29.678036 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.679377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.692707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a0b41-e25d-4b2a-b7ef-d03a46fb8eff admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.698402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.698740 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.699050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.699329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] PATH_INFO: `/v3/users/bdffd39da0b34fcbaad5ed26adaaef9c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.700581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdffd39da0b34fcbaad5ed26adaaef9c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.702564 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.748941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1344/2675] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:29 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:29.752821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.755193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:29.772135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf7242-d412-4079-a7aa-eb904e5f39d5 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.772135 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.772665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.773059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.773416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.774328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.775768 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.786777 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1345/2676] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:29.790426 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.800280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb3788-d17f-419e-948a-04acd56d7017 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.805504 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.806221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.806652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.806940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.807696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.809297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.822134 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1346/2677] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:29.828737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:29.838836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd713410-19c2-408d-adad-c06c057b5ed8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:29.849204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:29.849204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.849204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.849204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] PATH_INFO: `/v3/projects/b9f62ed2e99d42b98d43496c68bbde02/users/79ad1bc25edc4288bb59d6ad3c8ddda9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.860929 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f62ed2e99d42b98d43496c68bbde02, user_id=79ad1bc25edc4288bb59d6ad3c8ddda9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:29.864184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28cfbea-0d55-4a9b-b46e-d37ef076a59d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:29.949611 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1347/2678] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:29 2022] PUT /identity/v3/projects/b9f62ed2e99d42b98d43496c68bbde02/users/79ad1bc25edc4288bb59d6ad3c8ddda9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:29.960831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:29.960831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:29.960831 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:29.985355 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdffd39da0b34fcbaad5ed26adaaef9c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:29.992201 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] MFA Rules not processed for user `79ad1bc25edc4288bb59d6ad3c8ddda9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:29.993541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:30.000298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdffd39da0b34fcbaad5ed26adaaef9c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.008741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdffd39da0b34fcbaad5ed26adaaef9c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.009460 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdffd39da0b34fcbaad5ed26adaaef9c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.010438 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdffd39da0b34fcbaad5ed26adaaef9c'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.033195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:30.065039 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1348/2679] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:30.076126 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:30.077492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:30.086715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1332/2680] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:29 2022] DELETE /identity/v3/users/bdffd39da0b34fcbaad5ed26adaaef9c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:30.153839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486623b1-51fb-403c-ba5f-6838acc502d2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:30.208392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:30.226457 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:30.228285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:30.228285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:30.228285 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:30.286311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:30.287808 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9697fe-5624-4acb-af4d-6020d58744da service nova] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:30.296748 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1349/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:30.413126 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:30.414657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:30.445301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=76,keystone:DELETE=21,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:30.487945 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf969d-9599-4a8c-9d63-25283717c4c2 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:30.493063 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:30.493935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:30.494218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:30.494493 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] PATH_INFO: `/v3/projects/e247d6ea61d6448b9f2082e53ac4d091` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:30.495671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e247d6ea61d6448b9f2082e53ac4d091)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:30.497593 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:30.715095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e247d6ea61d6448b9f2082e53ac4d091', 'request_id': 'req-464d16a7-94cc-469f-9395-63d30025774f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.720741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e247d6ea61d6448b9f2082e53ac4d091', 'request_id': 'req-464d16a7-94cc-469f-9395-63d30025774f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.864159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e247d6ea61d6448b9f2082e53ac4d091', 'request_id': 'req-464d16a7-94cc-469f-9395-63d30025774f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.875710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] The token cache is being invalidate because project e247d6ea61d6448b9f2082e53ac4d091 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:30.876002 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.876634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-464d16a7-94cc-469f-9395-63d30025774f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:30.878231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1333/2682] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:30 2022] DELETE /identity/v3/projects/e247d6ea61d6448b9f2082e53ac4d091 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:30.883154 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:30.883475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:30.883757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:30.902355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:30.903559 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:30.965416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1350/2683] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:30.974731 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:30.975024 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:30.975307 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.014935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:31.016179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:31.025164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1334/2684] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:31.029643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.039864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85323eb-4e72-4115-a503-39d4d5e1af5c None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.044623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.045275 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.045557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.045827 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.046584 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:31.046889 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.048462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.069991 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1351/2685] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:31.073388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.083531 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd6e4a-51af-47e1-bb8a-3cfc77d3c3de None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.088584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.089314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.089673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.090054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.090862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.098768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.188920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1335/2686] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:31 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:31.193010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.203038 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec72f48-fd6c-4623-8685-364db3cbcfc2 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.260226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.260888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.261171 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.261448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.262176 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.264079 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.360799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1352/2687] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:31 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:31.364755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.375266 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15cd1a4-5386-4b46-b8f2-bba5b3c7e0c0 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.379948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.380601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.380886 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.381162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.381917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.383506 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.394153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1336/2688] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:31.398470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.408328 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090334da-849d-4458-8912-3317f6a37bc8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.413617 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.414305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.414591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.414867 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.415669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.417250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926227b-2d7d-45bf-9113-c6d628e4348e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.418509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:31.428812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1353/2689] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:31.432902 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.443270 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820818f-84a9-4b04-9f5f-96bab5c74c20 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.448066 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.448980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.449292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.449571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] PATH_INFO: `/v3/projects/710292081e254877bdf3057c2db3c123/users/d63546b8b93f461abbf4562baa90f5d9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.465269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710292081e254877bdf3057c2db3c123, user_id=d63546b8b93f461abbf4562baa90f5d9, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.467979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.549323 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1337/2690] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:31 2022] PUT /identity/v3/projects/710292081e254877bdf3057c2db3c123/users/d63546b8b93f461abbf4562baa90f5d9/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:31.559792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.560088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.560372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.587448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] MFA Rules not processed for user `d63546b8b93f461abbf4562baa90f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:31.588652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:31.666345 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1354/2691] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:31.666784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.666784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:31.710583 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:31.721760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7c06b-44c8-4b1c-a235-eb667602da25 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.726021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.726669 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.726954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.727234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.737042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.739251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f010c88e-7efe-4505-9c69-e836c40a6cea service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:31.748587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1338/2692] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:31.772666 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:31.835464 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7bb7f-75fc-4876-9f8c-e63b579bdd35 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:31.840058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:31.840917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:31.841194 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:31.841465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] PATH_INFO: `/v3/users/d63546b8b93f461abbf4562baa90f5d9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:31.842683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63546b8b93f461abbf4562baa90f5d9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:31.844577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:32.027879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:32.028170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:32.028474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:32.047783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:32.049105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:32.104174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1339/2693] 10.222.0.42 () {58 vars in 1009 bytes} [Fri Jun 24 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:32.110283 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63546b8b93f461abbf4562baa90f5d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:32.116829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:32.118402 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:32.124468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63546b8b93f461abbf4562baa90f5d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:32.199409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2e8eb-b128-404f-943d-6f4658b0b700 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:32.200483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63546b8b93f461abbf4562baa90f5d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:32.201111 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63546b8b93f461abbf4562baa90f5d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:32.206838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:32.208262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:32.208641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:32.209011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:32.209935 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-7f180f20-9426-4a07-b8c8-0d83d6e0d6bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63546b8b93f461abbf4562baa90f5d9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:32.216723 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1355/2694] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:31 2022] DELETE /identity/v3/users/d63546b8b93f461abbf4562baa90f5d9 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:32.220519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:32.222277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:32.223840 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:32.224252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:32.224784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:32.231511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1340/2695] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 03:56:32.239483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:32.254367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:32.254367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:32.313329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1356/2696] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:32.322973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:32.324466 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:32.395626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ed1e0-8e55-4feb-b804-60fd955c632f service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:32.441571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:32.460547 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:32.461428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:32.464733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:32.464733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:32.473607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:32.475137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070040e-eebd-4316-be4d-75dadc02d718 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:32.489029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1341/2697] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:33.108975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:33.110925 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:33.127548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fb2d7-257c-4329-8002-ef7d79d2897a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:33.135050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:33.136167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.136589 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.136857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] PATH_INFO: `/v3/projects/710292081e254877bdf3057c2db3c123` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.138331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710292081e254877bdf3057c2db3c123)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:33.140569 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:33.305254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710292081e254877bdf3057c2db3c123', 'request_id': 'req-e584e014-4480-43a4-8d9a-f8f248b14ad8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:33.311986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710292081e254877bdf3057c2db3c123', 'request_id': 'req-e584e014-4480-43a4-8d9a-f8f248b14ad8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:33.469261 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710292081e254877bdf3057c2db3c123', 'request_id': 'req-e584e014-4480-43a4-8d9a-f8f248b14ad8'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:33.483205 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] The token cache is being invalidate because project 710292081e254877bdf3057c2db3c123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:33.483729 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:33.484644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-e584e014-4480-43a4-8d9a-f8f248b14ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:33.486784 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1357/2698] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:33 2022] DELETE /identity/v3/projects/710292081e254877bdf3057c2db3c123 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:33.492442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.492920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.493017 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.513392 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:33.514880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:33.596400 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1342/2699] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:33.604801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.608540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.608540 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.629766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:33.631380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:33.644229 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1358/2700] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:33.648638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:33.659735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd372d0-8e72-4737-a046-46e449032c14 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:33.665473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:33.666164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.666447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.666723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.667769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:33.668042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:33.669689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:33.687548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1343/2701] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:33.688359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:33.699080 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f0252-8bb9-4616-b73a-4f112028dad2 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:33.704161 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:33.704818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.705098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.705367 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.706123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:33.708060 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:33.835850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1359/2702] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:33 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:33.837322 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:33.854164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdb427-5882-4d1f-8c90-0e9da16ebdfc admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:33.943792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:33.944556 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:33.944913 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:33.945261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:33.946074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:33.948245 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:34.085534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1344/2703] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:33 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:34.086858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:34.099193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a64f1-873f-4f8c-8b53-ece72cb34127 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:34.105719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:34.106724 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:34.107143 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:34.107467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:34.108498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:34.110698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:34.132522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1360/2704] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:34.133597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:34.147989 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70cb76-dccd-4bc9-9372-51c6c8539a5e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:34.153261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:34.154370 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:34.155753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:34.156254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:34.157304 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:34.159219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405691c7-5755-4057-b5d3-925c22ddb3da admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:34.176172 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1345/2705] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:34.181669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:34.192004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ec6d8-8c38-491f-b62b-38a1a47eccad admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:34.197681 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:34.198600 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:34.199159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:34.199321 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] PATH_INFO: `/v3/projects/b07e13a6b00045f79369422c253fdf9b/users/0fba0f6669234684907d1878d204f377/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:34.217511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b07e13a6b00045f79369422c253fdf9b, user_id=0fba0f6669234684907d1878d204f377, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:34.220849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:34.328566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1361/2706] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:34 2022] PUT /identity/v3/projects/b07e13a6b00045f79369422c253fdf9b/users/0fba0f6669234684907d1878d204f377/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:34.340702 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:34.340979 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:34.341271 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:34.369529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] MFA Rules not processed for user `0fba0f6669234684907d1878d204f377`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:34.370901 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:34.408101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:34.450911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1346/2707] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:34.459123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:34.460843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:34.492523 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:34.527363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd1ccc-aa3c-43d5-b019-e2b2694e2ef0 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:34.533431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:34.534217 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:34.534534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:34.534850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:34.544753 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:34.546326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c24c7-e236-4578-ae59-2c24c17bc8e0 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:34.557119 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1362/2708] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:36.949231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:36.950776 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:37.046274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90198-3ecd-4043-acce-80bcb10b4791 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:37.051543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:37.052557 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:37.052864 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:37.053125 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] PATH_INFO: `/v3/users/79ad1bc25edc4288bb59d6ad3c8ddda9` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:37.056145 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ad1bc25edc4288bb59d6ad3c8ddda9)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:37.058098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:37.277597 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ad1bc25edc4288bb59d6ad3c8ddda9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:37.293098 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ad1bc25edc4288bb59d6ad3c8ddda9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:37.305429 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ad1bc25edc4288bb59d6ad3c8ddda9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:37.306608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ad1bc25edc4288bb59d6ad3c8ddda9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:37.307347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ad1bc25edc4288bb59d6ad3c8ddda9'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:37.414434 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1347/2709] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:36 2022] DELETE /identity/v3/users/79ad1bc25edc4288bb59d6ad3c8ddda9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:37.419397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:37.419897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:37.420109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:37.447897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:37.449941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:37.535894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1363/2710] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:37.542418 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:37.544188 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:37.617546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6386857-1ff5-4a7a-ae37-f6e8edcc6237 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:37.623925 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:37.624576 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:37.624889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:37.625159 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:37.638267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:37.640202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cfefbf-fa4f-429a-ba00-171157da37f5 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:37.645101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:37.653469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1348/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:38.213638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:38.219010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:38.236866 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1c2f9-dae1-4b43-b8a8-836911f9532b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:38.252290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:38.252290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:38.252290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:38.252290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] PATH_INFO: `/v3/projects/b9f62ed2e99d42b98d43496c68bbde02` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:38.252616 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f62ed2e99d42b98d43496c68bbde02)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:38.253800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:38.690115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f62ed2e99d42b98d43496c68bbde02', 'request_id': 'req-f485cf0d-1cc5-49e8-9361-29b4c5986246'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:38.696308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f62ed2e99d42b98d43496c68bbde02', 'request_id': 'req-f485cf0d-1cc5-49e8-9361-29b4c5986246'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:38.926737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f62ed2e99d42b98d43496c68bbde02', 'request_id': 'req-f485cf0d-1cc5-49e8-9361-29b4c5986246'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:38.938931 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] The token cache is being invalidate because project b9f62ed2e99d42b98d43496c68bbde02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:38.939215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:38.939845 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f485cf0d-1cc5-49e8-9361-29b4c5986246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:38.941446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1364/2712] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:38 2022] DELETE /identity/v3/projects/b9f62ed2e99d42b98d43496c68bbde02 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:38.946269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:38.946741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:38.946839 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:38.965191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:38.966451 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:39.105908 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1349/2713] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:39.114004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.114295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.114789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.137203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:39.138898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:39.149241 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1365/2714] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:39.154759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.170701 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8f81f-555d-41a3-981a-527e8342095c None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.178889 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.179933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.180388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.180825 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.182154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:39.182628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.192645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.205954 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1350/2715] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:39.207267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.218483 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deacc85-db82-443e-8f21-1fe1c732011b None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.224376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.225282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.225649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.226123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.226864 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.229606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.361682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1366/2716] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:39 2022] POST /identity/v3/projects => generated 403 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:39.364862 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.375961 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ffc93-1858-4877-9c81-7f439fa983d8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.456207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.457440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.457741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.458042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.458790 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.460655 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.579254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1351/2717] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:39 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:39.584165 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.595636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf759f7b-2c07-4256-a429-79552437da60 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.601577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.602425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.603075 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.603305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.604709 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.606579 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.621725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1367/2718] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:39.623766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.640942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313b6e-dc00-4704-8411-2695b45682a3 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.648647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.649314 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.649598 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.649918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.650725 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.652433 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72b6e5-7b41-44c6-bd3a-ce16565d424f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.666518 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1352/2719] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:39.670558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:39.682122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66c234-d5a3-440d-aa1b-29c89faf9857 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:39.687996 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:39.694891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.695588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.695588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] PATH_INFO: `/v3/projects/735913fab74f4c1891114de52edf46cc/users/05903d056c4a4e449eefe94c151b9800/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.706106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:39.715830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735913fab74f4c1891114de52edf46cc, user_id=05903d056c4a4e449eefe94c151b9800, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:39.718901 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:39.831876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1368/2720] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:39 2022] PUT /identity/v3/projects/735913fab74f4c1891114de52edf46cc/users/05903d056c4a4e449eefe94c151b9800/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:39.839079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:39.839488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:39.839872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:39.885549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] MFA Rules not processed for user `05903d056c4a4e449eefe94c151b9800`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:39.887959 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:39.970041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:40.001558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1353/2721] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:40.006472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.086796 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe9569-f485-4fdd-bce8-1944ab2482f2 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.092632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.093421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.093775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.094088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.094797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.096685 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.228587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1369/2722] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:40 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:40.233051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.247012 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff21e40-aaee-410a-97a4-bd20ab5bd151 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.331552 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.332281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.332561 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.332837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.333533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.335478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.419062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1354/2723] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:40 2022] POST /identity/v3/users => generated 309 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:40.423128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.439503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752ec5a-c3e5-4e4a-bfab-559b8190cb25 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.447448 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.448408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.448697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.449138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.450427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.452219 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.471344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1370/2724] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:40.475897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.487870 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f95b85-fdd4-40c4-8eea-c469611955a6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.492885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.495346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.495346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.495346 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] PATH_INFO: `/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0/users/6c46a865ad0a47e09dac5e96abf198e9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.512473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d1d444eb8847b88e12d8f6f1b179c0, user_id=6c46a865ad0a47e09dac5e96abf198e9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.515474 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.625715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1355/2725] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:40 2022] PUT /identity/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0/users/6c46a865ad0a47e09dac5e96abf198e9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:40.631313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.646903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd848-0194-439a-bb96-b93e4bde21f9 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.730263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.731048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.731156 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.731676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.732869 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.735953 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434cbdc2-00f0-43eb-a56a-af1fc36e2977 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.754625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1371/2726] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:40 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:40.759067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.772627 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b62f9d-3037-4a5d-8cc8-9aaca2cdbf7c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:40.780140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:40.781548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.781928 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.782301 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] PATH_INFO: `/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0/users/6c46a865ad0a47e09dac5e96abf198e9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.785800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d1d444eb8847b88e12d8f6f1b179c0, user_id=6c46a865ad0a47e09dac5e96abf198e9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:40.789378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:40.801584 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1356/2727] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:40 2022] PUT /identity/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0/users/6c46a865ad0a47e09dac5e96abf198e9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:40.812602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:40.813130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:40.813567 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:40.846832 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] MFA Rules not processed for user `6c46a865ad0a47e09dac5e96abf198e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:40.848854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:40.901744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:40.929337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1372/2728] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:40.941160 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:40.943639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:41.032026 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2e60d-b5e0-4b20-9a44-0a1410c776cf admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:41.037327 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:41.038078 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:41.038405 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:41.038770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:41.050905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:41.052297 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669556f7-798e-4c14-a437-e2d9e1b8ff0e service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:41.063754 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1357/2729] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:40 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:41.221396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:41.297188 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36fa14-e9ff-4508-bde2-0ea4915a7059 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:41.303191 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:41.304224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:41.304606 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:41.304981 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] PATH_INFO: `/v3/users/05903d056c4a4e449eefe94c151b9800` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:41.306418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05903d056c4a4e449eefe94c151b9800)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:41.308699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:41.497027 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05903d056c4a4e449eefe94c151b9800'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:41.511834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05903d056c4a4e449eefe94c151b9800'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:41.623166 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05903d056c4a4e449eefe94c151b9800'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:41.624859 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05903d056c4a4e449eefe94c151b9800'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:41.631615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05903d056c4a4e449eefe94c151b9800'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:41.638528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1373/2730] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:41 2022] DELETE /identity/v3/users/05903d056c4a4e449eefe94c151b9800 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:41.643388 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:41.644497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:41.644842 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:41.665860 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:41.666097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:41.714338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:41.730267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1358/2731] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:41.740259 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:41.741696 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:41.805492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1309a2-3f46-42ae-8bc0-ed29b02da585 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:41.809409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:41.810017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:41.810300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:41.810573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:41.822447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:41.823971 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:41.835903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1374/2732] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:42.503574 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:42.507723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:42.538235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830dec2-939f-46b7-8b95-9d0634869c62 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:42.540737 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:42.541843 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:42.542328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:42.542673 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] PATH_INFO: `/v3/projects/735913fab74f4c1891114de52edf46cc` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:42.543947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735913fab74f4c1891114de52edf46cc)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:42.546102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:42.724592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735913fab74f4c1891114de52edf46cc', 'request_id': 'req-dca8819b-6842-46e5-b1fc-e02b2edb7c41'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:42.730753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735913fab74f4c1891114de52edf46cc', 'request_id': 'req-dca8819b-6842-46e5-b1fc-e02b2edb7c41'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:42.828805 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735913fab74f4c1891114de52edf46cc', 'request_id': 'req-dca8819b-6842-46e5-b1fc-e02b2edb7c41'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:42.842283 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] The token cache is being invalidate because project 735913fab74f4c1891114de52edf46cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:42.842596 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:42.843252 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:42.845081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1359/2733] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:42 2022] DELETE /identity/v3/projects/735913fab74f4c1891114de52edf46cc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:42.849609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:42.856256 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:42.860676 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb74a34-b668-4220-995c-ce798362a628 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:42.926137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:42.927098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:42.927355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:42.927632 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] PATH_INFO: `/v3/users/6c46a865ad0a47e09dac5e96abf198e9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:42.929047 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c46a865ad0a47e09dac5e96abf198e9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:42.931044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:43.163537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c46a865ad0a47e09dac5e96abf198e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.186649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c46a865ad0a47e09dac5e96abf198e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.284828 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:43.287335 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:43.287715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c46a865ad0a47e09dac5e96abf198e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.288377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c46a865ad0a47e09dac5e96abf198e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.297034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f468a738-a08b-454d-bdcf-da58fc3aeb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c46a865ad0a47e09dac5e96abf198e9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.304611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8819b-6842-46e5-b1fc-e02b2edb7c41 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:43.307147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1375/2734] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:42 2022] DELETE /identity/v3/users/6c46a865ad0a47e09dac5e96abf198e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:43.392235 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:43.393540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:43.393830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:43.394789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] PATH_INFO: `/v3/users/0fba0f6669234684907d1878d204f377` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:43.396538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fba0f6669234684907d1878d204f377)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:43.398560 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:43.653067 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fba0f6669234684907d1878d204f377'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.677441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fba0f6669234684907d1878d204f377'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.692439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fba0f6669234684907d1878d204f377'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.693918 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fba0f6669234684907d1878d204f377'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.694671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fba0f6669234684907d1878d204f377'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:43.696761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:43.792035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1360/2735] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:43 2022] DELETE /identity/v3/users/0fba0f6669234684907d1878d204f377 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:43.793528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:43.793891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:43.794215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:43.815525 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:43.820619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:43.822674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:43.827962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:43.904739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1376/2736] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:43.913206 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:43.916022 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:43.951344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bea1d7-ed5b-4d82-8701-87ad077f350c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:43.951858 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:43.957129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:43.958243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:43.958675 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:43.959123 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] PATH_INFO: `/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:43.960544 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d1d444eb8847b88e12d8f6f1b179c0)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:43.962658 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:43.995287 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5958190-4240-4487-96e4-187e6a9107ff None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.003875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:44.004537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.004819 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.005095 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.015139 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:44.016652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28418cce-d612-4a8d-977e-3a87dc2be7af service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:44.027791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1377/2737] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:44.133534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d1d444eb8847b88e12d8f6f1b179c0', 'request_id': 'req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.157021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d1d444eb8847b88e12d8f6f1b179c0', 'request_id': 'req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.275996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d1d444eb8847b88e12d8f6f1b179c0', 'request_id': 'req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.305998 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] The token cache is being invalidate because project 43d1d444eb8847b88e12d8f6f1b179c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:44.306611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.307791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d9d604f9-7ed9-42dc-88b9-b98bb85d5231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.309680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1361/2738] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:43 2022] DELETE /identity/v3/projects/43d1d444eb8847b88e12d8f6f1b179c0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:44.314787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.315086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.315357 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.349456 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:44.351412 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:44.456490 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1378/2739] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:44.461247 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.463141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.463141 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.501545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:44.503222 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:44.515837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1362/2740] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:44.521705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:44.531764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36045349-c44c-4f4c-86ac-833b941ba126 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.536781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:44.537558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.537980 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.538376 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.539499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:44.539903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:44.541642 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:44.554871 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1379/2741] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:44.559391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:44.570273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68adcfc6-9fab-4e31-a3e5-ef4b4c64ef82 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.575477 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:44.576216 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.576606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.576957 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.577723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:44.579753 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:44.644513 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:44.645450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:44.661541 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343e79f-35ec-43a3-9312-ad26ce848335 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.667564 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:44.668554 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.668961 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.669338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] PATH_INFO: `/v3/projects/b07e13a6b00045f79369422c253fdf9b` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.670764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b07e13a6b00045f79369422c253fdf9b)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:44.673115 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:44.695667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1363/2742] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:44 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:44.696550 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:44.762129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:44.774217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb8659-fc9c-4f8a-a0bd-e907597d3ae9 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.779116 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:44.779773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.780062 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.780339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:44.781041 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:44.783101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:44.841542 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b07e13a6b00045f79369422c253fdf9b', 'request_id': 'req-1746287d-d8d2-4924-a436-d33671df52c4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.856323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b07e13a6b00045f79369422c253fdf9b', 'request_id': 'req-1746287d-d8d2-4924-a436-d33671df52c4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.927360 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1364/2743] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:44 2022] POST /identity/v3/users => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:44.932137 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:44.943599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0170cf1a-b36d-4f0a-ab28-720ce92f3699 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:44.970077 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b07e13a6b00045f79369422c253fdf9b', 'request_id': 'req-1746287d-d8d2-4924-a436-d33671df52c4'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.983320 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] The token cache is being invalidate because project b07e13a6b00045f79369422c253fdf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:44.983615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.984326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1746287d-d8d2-4924-a436-d33671df52c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:44.986714 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1380/2744] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:44 2022] DELETE /identity/v3/projects/b07e13a6b00045f79369422c253fdf9b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:44.991662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db536-65e7-408b-917b-7d5543ffab3b None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:44.991949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db536-65e7-408b-917b-7d5543ffab3b None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:44.992233 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db536-65e7-408b-917b-7d5543ffab3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.015007 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-9e7db536-65e7-408b-917b-7d5543ffab3b None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:45.016333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-9e7db536-65e7-408b-917b-7d5543ffab3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:45.030746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.031439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.031728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.032004 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.032733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.091545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.091545 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1365/2745] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:45.091818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:45.091818 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1381/2746] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:45.093234 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.095180 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:45.095695 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.096086 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.096462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.108154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59588487-d20d-4dea-a876-9173350ae1d4 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.113469 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.114191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.114511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.114958 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:45.115093 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.115914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.116167 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:45.117559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.124203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1382/2747] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:45.128805 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.129801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1366/2748] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:45.134453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.138159 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e4c83-3f23-4b82-ab46-70397ab5da67 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.143591 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.144963 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.145291 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.145571 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.145771 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ab11d2-dc16-4bb2-9ff2-83918baa64c6 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.146397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:45.146806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.148627 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.151102 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.152000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.152299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.152601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] PATH_INFO: `/v3/projects/da89193169024c64ae72ae3015fa19bd/users/b823e8380cc245dc89286c84e982336b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.163342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1383/2749] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:56:45.167138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.169606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da89193169024c64ae72ae3015fa19bd, user_id=b823e8380cc245dc89286c84e982336b, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.172293 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27636d9-6bdf-4255-85a0-6ab3ae1fac9f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.178778 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aefae5-b7d9-4232-8918-b55077f2643c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.184268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.185084 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.185445 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.185781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.186626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.188587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.435677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1367/2750] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:45 2022] PUT /identity/v3/projects/da89193169024c64ae72ae3015fa19bd/users/b823e8380cc245dc89286c84e982336b/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:45.440559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.443609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.443609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.456468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1384/2751] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:45 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:45.457486 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.459917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:45.461129 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:45.534872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1368/2752] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:45.538804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf66ef9-419e-47c7-94d2-4987ba5dbd4f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.551692 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.551951 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.552380 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.552665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.552940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.553643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.554015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:45.555675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.637177 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e894d626-6ad9-4cdb-9bbd-131dc0f35abd None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.640999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.642100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.642490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.642986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.656169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.657923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.658384 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1385/2753] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:45 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:45.664699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.671749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1369/2754] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:45.678622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07e720-a69e-4af2-91c4-098313461cdc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.684298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.685311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.685900 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.686349 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.687472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.689562 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.705548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1386/2755] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:45.707214 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.718194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8156e-a5de-4862-9eaf-d6d4c18e5d95 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.723802 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.724540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.724894 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.725248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.727193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.727766 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f240c10-a6c3-43ed-8bd0-ca7893e27802 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.739292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1370/2756] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:45.744265 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:45.755875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065a39-7923-4fb6-9a86-6ccceaeef48a admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:45.761793 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:45.762936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.763327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.763719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] PATH_INFO: `/v3/projects/bb4950164d0747328cc51403c0e1362c/users/0f47baa8cfc8492aaf3184079c654cc4/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.781773 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4950164d0747328cc51403c0e1362c, user_id=0f47baa8cfc8492aaf3184079c654cc4, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:45.787689 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:45.921279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1387/2757] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:45 2022] PUT /identity/v3/projects/bb4950164d0747328cc51403c0e1362c/users/0f47baa8cfc8492aaf3184079c654cc4/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:45.932035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:45.932330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:45.932677 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:45.964783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] MFA Rules not processed for user `0f47baa8cfc8492aaf3184079c654cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:45.964783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:46.040885 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1371/2758] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:46.045125 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.121248 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:46.127469 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becd669-b6e2-4341-9f55-647752f4998e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:46.132861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:46.133734 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.134532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.134532 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.135708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:46.138094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:46.275621 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1388/2759] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:46.280535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.293833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd93f2-8f1a-4ba0-82c3-4c7332c38cac None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:46.366524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:46.367241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.367595 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.368013 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.368888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:46.371852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:46.382012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:46.484624 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1372/2760] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:46 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:46.494608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.512431 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c367d0f-f066-457d-9eca-2f85bf09d974 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:46.522835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:46.523264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.523715 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.524136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.525207 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:46.527535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:46.546368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1389/2761] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:46.551714 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.567380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd27f49b-4fa5-4af9-b959-368e57536f10 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:46.580171 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:46.581838 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.583537 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.583833 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.585100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:46.586997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed5e0c-f20a-4023-ab8f-97ac7837a88e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:46.601884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1373/2762] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:46.605487 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.618517 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6221a-ab11-4dc0-a764-ec474975dc29 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:46.624716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:46.624716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.624716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.625248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] PATH_INFO: `/v3/projects/fc4e792cc10b40f29fbcbc17d7173b1b/users/740b8b8d49314e75911588735db51f32/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.653105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4e792cc10b40f29fbcbc17d7173b1b, user_id=740b8b8d49314e75911588735db51f32, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:46.656366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:46.756884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1390/2763] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:46 2022] PUT /identity/v3/projects/fc4e792cc10b40f29fbcbc17d7173b1b/users/740b8b8d49314e75911588735db51f32/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:46.768762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:46.770565 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:46.771064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:46.812875 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] MFA Rules not processed for user `740b8b8d49314e75911588735db51f32`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:46.815166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:46.874328 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:46.916498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1374/2764] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:46.921694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:46.998733 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4400ac-f4d3-410a-ac52-cffeb0c782fc admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.001833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.002680 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.003034 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.004505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.005028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.007149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.122601 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.131489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1391/2765] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:46 2022] POST /identity/v3/projects => generated 385 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:47.142274 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a414e79-9a5f-460c-a705-1fd8e3a1feec None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.209155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.209829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.210303 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.217019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.217019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.217019 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.302972 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1375/2766] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:47 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:47.305614 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.327377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c32551-23d3-4d04-a482-d86c5ed1fad8 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.337032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.337972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.338215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.338492 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.339222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.340948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dde082-ccbe-4768-97d4-66d5f954ffaa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.360269 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1392/2767] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:47.366292 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.379514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.380266 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.380545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.384237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4ff82-8e8a-4952-83f0-e46381f42c26 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.402507 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.403428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.403780 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.404064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] PATH_INFO: `/v3/projects/8df988e2b7f54bf8b36152db37919201/users/1f388639fa8b461bb7e2ea5e4e6340a9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.436193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df988e2b7f54bf8b36152db37919201, user_id=1f388639fa8b461bb7e2ea5e4e6340a9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.439380 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.452300 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] MFA Rules not processed for user `b823e8380cc245dc89286c84e982336b`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:47.454100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:47.539300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1376/2768] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:47 2022] PUT /identity/v3/projects/8df988e2b7f54bf8b36152db37919201/users/1f388639fa8b461bb7e2ea5e4e6340a9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:47.543810 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.552536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1393/2769] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:47.553599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.562121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:47.570117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545efe0-80a0-4f4d-a9fc-4d7416fb3383 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.653468 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.654314 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.654608 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.654885 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.655593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.657573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.660549 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc51c0e-63ca-4ff6-9fef-05103f11a310 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.669122 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.670667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.671138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.671585 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.672879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.675040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.692774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1377/2770] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:47.694014 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.705880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a2b8-6d1e-4696-b56d-e5ec1193eb5c admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.713533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.714822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.715239 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.715613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] PATH_INFO: `/v3/projects/8df988e2b7f54bf8b36152db37919201/users/1f388639fa8b461bb7e2ea5e4e6340a9/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.718484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df988e2b7f54bf8b36152db37919201, user_id=1f388639fa8b461bb7e2ea5e4e6340a9, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.722504 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2cff0-0d3f-4b3e-80cb-28dac4428ea6 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.750705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1378/2771] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:47 2022] PUT /identity/v3/projects/8df988e2b7f54bf8b36152db37919201/users/1f388639fa8b461bb7e2ea5e4e6340a9/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:47.752548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.752977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.754298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.794977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] MFA Rules not processed for user `1f388639fa8b461bb7e2ea5e4e6340a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:47.796246 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:47.812425 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:47.817993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1394/2772] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:47 2022] POST /identity/v3/projects => generated 403 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:47.819104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.905888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1379/2773] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:47.915462 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e6a80c-94ec-46d0-b5d9-535ea3013853 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:47.916854 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:47.918299 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:47.923218 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:47.924537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:47.925088 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:47.925792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:47.927371 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:47.930938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:47.993633 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ceea0-a531-4f43-9f56-ffc1635f1111 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:48.064443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1395/2774] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:47 2022] POST /identity/v3/users => generated 308 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:48.065481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:48.072278 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:48.075083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:48.075603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:48.078106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:48.096749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe83e43e-848b-47ff-91fa-d79a78a1e098 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:48.106308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:48.107097 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:48.107379 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:48.107653 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:48.108423 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:48.110076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:48.126124 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1396/2775] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:48.131392 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:48.143372 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615ceaf-f598-4d0e-b4e1-2d401699a63b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:48.150142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:48.151323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:48.151671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:48.151956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] PATH_INFO: `/v3/projects/04f9627c3d9e40cab40474f264ab4732/users/ef7ee66b20fb4134b86a36f362bd1016/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:48.164277 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:48.165926 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:48.170902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f9627c3d9e40cab40474f264ab4732, user_id=ef7ee66b20fb4134b86a36f362bd1016, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:48.173812 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:48.177757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1380/2776] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:48.305919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1397/2777] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:48 2022] PUT /identity/v3/projects/04f9627c3d9e40cab40474f264ab4732/users/ef7ee66b20fb4134b86a36f362bd1016/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:48.306174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:48.319338 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942dde9-217b-42da-96c6-88d4acb602d5 service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:48.335705 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:48.389480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:48.390227 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:48.390519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:48.390821 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:48.391581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:48.393269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215a3d9-7a43-46ed-9b0a-a761c5bce636 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:48.406473 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1381/2778] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:48.411295 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:48.421612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071e8a-b2e5-47f3-9356-b5f56de1ae64 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:48.426319 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:48.427187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:48.427467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:48.427740 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] PATH_INFO: `/v3/projects/04f9627c3d9e40cab40474f264ab4732/users/ef7ee66b20fb4134b86a36f362bd1016/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:48.429701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f9627c3d9e40cab40474f264ab4732, user_id=ef7ee66b20fb4134b86a36f362bd1016, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:48.432316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35321d95-079c-49df-9a78-6a40ac1af507 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:48.442850 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1398/2779] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:48 2022] PUT /identity/v3/projects/04f9627c3d9e40cab40474f264ab4732/users/ef7ee66b20fb4134b86a36f362bd1016/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:49.993401 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:49.993976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:49.994081 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:50.021991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] MFA Rules not processed for user `ef7ee66b20fb4134b86a36f362bd1016`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:50.023241 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:50.092508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1382/2780] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:50.758324 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:50.758799 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:50.758909 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:50.777892 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] MFA Rules not processed for user `5cb3aeb090624fbc9ed64c7bb2ca4d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:50.779190 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:50.810897 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:50.842836 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1399/2781] 10.222.0.42 () {58 vars in 967 bytes} [Fri Jun 24 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:50.855734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:50.857264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:50.931977 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270f9a4-523d-415d-9018-7ad4ddca516f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:50.937236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '596a616025ee4112af72d799216c2fcf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:50.937827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:50.938147 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:50.938498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:50.953251 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:50.955109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:50.964193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1383/2782] 10.222.0.42 () {60 vars in 1384 bytes} [Fri Jun 24 03:56:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 03:56:51.498432 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:51.575668 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa5cb7-c067-41b8-9a03-81be4af7a359 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:51.580716 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:51.584639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:51.584639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:51.584639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] PATH_INFO: `/v3/users/b823e8380cc245dc89286c84e982336b` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:51.584639 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b823e8380cc245dc89286c84e982336b)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:51.585040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:51.585613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:51.585728 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:51.618618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=100 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:51.644741 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f6d-3419-4bcd-b7df-706f38890b34 service swift] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:51.648837 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:51.649486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:51.649792 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:51.650120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:51.706526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:51.707966 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:51.716726 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1384/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:51.808037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b823e8380cc245dc89286c84e982336b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:51.820835 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b823e8380cc245dc89286c84e982336b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:51.977215 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b823e8380cc245dc89286c84e982336b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:51.977868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b823e8380cc245dc89286c84e982336b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:51.985675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b823e8380cc245dc89286c84e982336b'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:51.992184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1400/2784] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:51 2022] DELETE /identity/v3/users/b823e8380cc245dc89286c84e982336b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:52.271194 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:52.288481 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ae81-f00c-4803-9f8c-2a092f0c308e service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:52.349136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:52.350039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:52.350326 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:52.350603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] PATH_INFO: `/v3/projects/da89193169024c64ae72ae3015fa19bd` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:52.351779 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=da89193169024c64ae72ae3015fa19bd)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:52.353668 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:52.613051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da89193169024c64ae72ae3015fa19bd', 'request_id': 'req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:52.618784 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da89193169024c64ae72ae3015fa19bd', 'request_id': 'req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:52.708163 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da89193169024c64ae72ae3015fa19bd', 'request_id': 'req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:52.722684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] The token cache is being invalidate because project da89193169024c64ae72ae3015fa19bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:52.722827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:52.723554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:52.727956 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1385/2785] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:52 2022] DELETE /identity/v3/projects/da89193169024c64ae72ae3015fa19bd => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:52.729561 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:52.731178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:52.745465 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f319d-5000-4090-aaba-70c95024f205 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:52.800884 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:52.807652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:52.808518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:52.809100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:52.809100 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] PATH_INFO: `/v3/users/ef7ee66b20fb4134b86a36f362bd1016` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:52.810297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef7ee66b20fb4134b86a36f362bd1016)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:52.812352 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:53.058155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef7ee66b20fb4134b86a36f362bd1016'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.070280 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef7ee66b20fb4134b86a36f362bd1016'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.234378 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef7ee66b20fb4134b86a36f362bd1016'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.234936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef7ee66b20fb4134b86a36f362bd1016'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.243035 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef7ee66b20fb4134b86a36f362bd1016'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.249023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1401/2786] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:52 2022] DELETE /identity/v3/users/ef7ee66b20fb4134b86a36f362bd1016 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:53.498949 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:53.500662 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:53.518443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3212dd-fcd6-4a12-9b78-5d66c6207abc admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:53.530296 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:53.579453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:53.580378 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:53.580667 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:53.580993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] PATH_INFO: `/v3/projects/04f9627c3d9e40cab40474f264ab4732` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:53.582774 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f9627c3d9e40cab40474f264ab4732)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:53.584707 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:53.749339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f9627c3d9e40cab40474f264ab4732', 'request_id': 'req-b076e9b6-a127-4a63-b468-270f3fb6d01f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.755543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f9627c3d9e40cab40474f264ab4732', 'request_id': 'req-b076e9b6-a127-4a63-b468-270f3fb6d01f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.868609 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f9627c3d9e40cab40474f264ab4732', 'request_id': 'req-b076e9b6-a127-4a63-b468-270f3fb6d01f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.871274 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:53.872781 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:53.880634 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] The token cache is being invalidate because project 04f9627c3d9e40cab40474f264ab4732 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:53.881011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.881643 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b076e9b6-a127-4a63-b468-270f3fb6d01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:53.883202 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1386/2787] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:53 2022] DELETE /identity/v3/projects/04f9627c3d9e40cab40474f264ab4732 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:53.888049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a7a6-d364-4906-91f2-a7f7f745c7d9 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:53.888332 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a7a6-d364-4906-91f2-a7f7f745c7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:53.888604 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9a7a6-d364-4906-91f2-a7f7f745c7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:53.907637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-aaf9a7a6-d364-4906-91f2-a7f7f745c7d9 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:53.908840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-aaf9a7a6-d364-4906-91f2-a7f7f745c7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:53.936359 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b1995-a85a-4cd4-8bc2-bb5c4effb684 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:53.971912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1387/2788] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:53.980215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:53.980514 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:53.980788 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:53.986330 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:53.986986 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:53.987267 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:53.987577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:53.989348 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:54.002536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:54.002536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:54.009372 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1388/2789] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:54.013691 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.023880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaf7f69-3816-4b5b-9fac-16a28a7e9b5e None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.030446 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.037069 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.049458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1389/2790] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:54.051844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:54.054490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.066423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466904f0-cf3c-48fd-8573-7d62cae69448 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.071434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.072955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.073458 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.073770 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.074097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.074377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.075073 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.077718 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.084409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1402/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:54.209895 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1390/2792] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:54 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:54.212839 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.223347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ac5a8-a1ff-4a2c-bd7a-2c60511d4366 service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.279747 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.280334 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.280618 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.280894 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.281592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.283521 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.381057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1403/2793] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:54 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:54.382279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.388008 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:54.393369 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b089a22-6484-4120-8142-db0481b834fe admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.398339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.401240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.401240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.401240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.401240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.402087 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.415808 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1391/2794] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:54.417010 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.428548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d91c0-221c-4fc1-845b-9df6524e1f89 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.433329 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.434018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.434304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.434700 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.435436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.437025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bf218-33ef-4f2b-aa7b-9e0d1b7d0ff1 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.448447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1404/2795] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:54.452672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.463857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba10dac-9d96-4ab2-afa3-7e214b880390 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.468660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.470734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.470734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.470734 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] PATH_INFO: `/v3/projects/0101425f60a74217b816715002f86052/users/514fdfc40d454ef69219530911b0cbdf/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.484845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0101425f60a74217b816715002f86052, user_id=514fdfc40d454ef69219530911b0cbdf, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.488037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.604155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1392/2796] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:54 2022] PUT /identity/v3/projects/0101425f60a74217b816715002f86052/users/514fdfc40d454ef69219530911b0cbdf/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:54.615938 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.616232 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.616516 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.645745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] MFA Rules not processed for user `514fdfc40d454ef69219530911b0cbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:54.647032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:54.713631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1405/2797] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:54.718186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.744355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:54.745844 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:54.788969 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4861f-ad82-4598-a887-670ecf7f16e1 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.794054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.795043 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.795329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.795608 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.796311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.797626 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:54.798223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.814985 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f56be4-3043-4881-a371-482fc4b72d0a None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:54.819948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:54.820923 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:54.821363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:54.821558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] PATH_INFO: `/v3/users/d1a236e9354d4b63840ae1d0907cac79` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:54.823016 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a236e9354d4b63840ae1d0907cac79)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:54.825279 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:54.945040 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1393/2798] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:54 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:54.949054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.012602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf66e8-7c63-4fc5-b304-ec2f20c12f93 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.017366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.018074 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.018363 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.018670 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.019406 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.021334 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.035322 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a236e9354d4b63840ae1d0907cac79'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.046801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a236e9354d4b63840ae1d0907cac79'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.160659 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1394/2799] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:54 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:55.164572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.172788 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a236e9354d4b63840ae1d0907cac79'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.173399 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a236e9354d4b63840ae1d0907cac79'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.174279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdcd1da-ac6f-46ea-8543-bc562ceb1122 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.179519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.180161 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.180479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.180760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.181698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.181822 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a236e9354d4b63840ae1d0907cac79'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.183637 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.188369 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1406/2800] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:54 2022] DELETE /identity/v3/users/d1a236e9354d4b63840ae1d0907cac79 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:55.195190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1395/2801] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:55.198893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.200290 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.266323 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4cebc5-f476-4fe7-b3dc-77cacca7503c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.271411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.272302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.272585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.272868 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] PATH_INFO: `/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff/users/66bf41dad53b4146b3e90dcb1c3fc55e/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.289142 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3ff8878f5d4cc4a5239fdbf7c8afff, user_id=66bf41dad53b4146b3e90dcb1c3fc55e, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.290410 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.367847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1407/2802] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:55 2022] PUT /identity/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff/users/66bf41dad53b4146b3e90dcb1c3fc55e/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:55.370689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.381428 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e77b389-a653-428e-b2ec-3e66e78f9095 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.411162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:55.440548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.441219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.441503 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.441777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.442555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.444208 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.454719 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1396/2803] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:55.460520 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.465285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.471193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab510-8d1c-4869-a2bf-953e2000d235 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.473724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.485001 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.485934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.486221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.486500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] PATH_INFO: `/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff/users/66bf41dad53b4146b3e90dcb1c3fc55e/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.489064 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379c96c-22dd-416e-b002-d37f7d0b8ad0 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.489204 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca3ff8878f5d4cc4a5239fdbf7c8afff, user_id=66bf41dad53b4146b3e90dcb1c3fc55e, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.492052 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29033357-9f25-45d0-bc83-4885737a99a3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.494698 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.495912 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.496203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.496486 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] PATH_INFO: `/v3/projects/aa804261a02848f98d5b9fb27c9eada3` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.498029 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa804261a02848f98d5b9fb27c9eada3)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.503039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.505834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1408/2804] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:55 2022] PUT /identity/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff/users/66bf41dad53b4146b3e90dcb1c3fc55e/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:55.516354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.516669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.517140 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.545137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] MFA Rules not processed for user `66bf41dad53b4146b3e90dcb1c3fc55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:55.546360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.572547 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:55.615623 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1409/2805] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:55.626543 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.628970 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.646757 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa804261a02848f98d5b9fb27c9eada3', 'request_id': 'req-8a02650f-ebe0-428c-b588-ce3e1cfe2095'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.652523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa804261a02848f98d5b9fb27c9eada3', 'request_id': 'req-8a02650f-ebe0-428c-b588-ce3e1cfe2095'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.685677 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f53cb6-ebdf-455e-adc9-e9e6fce5c671 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.731377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa804261a02848f98d5b9fb27c9eada3', 'request_id': 'req-8a02650f-ebe0-428c-b588-ce3e1cfe2095'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.736789 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.738221 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.738505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.738786 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.743548 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] The token cache is being invalidate because project aa804261a02848f98d5b9fb27c9eada3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:55.743857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.744921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8a02650f-ebe0-428c-b588-ce3e1cfe2095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:55.746529 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1397/2806] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:55 2022] DELETE /identity/v3/projects/aa804261a02848f98d5b9fb27c9eada3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:55.751158 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.751445 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.751724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.770628 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:55.772179 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.804306 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.805756 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c270a3-db7d-469a-a238-afb56a8f8b7a service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.815505 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1410/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:55.834540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1398/2808] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:55.851791 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.852373 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.852669 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.853098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.853244 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.865413 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c4e35-b7b2-4e16-baac-d3fb1898a205 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.870471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.871341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.871630 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.871910 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] PATH_INFO: `/v3/users/514fdfc40d454ef69219530911b0cbdf` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.872919 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:55.873264 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=514fdfc40d454ef69219530911b0cbdf)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.874213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:55.875236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.882646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1411/2809] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:56:55.887422 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.899479 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c997a1-2615-4315-ab3d-10651447fdae None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.904792 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.905436 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.905722 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.906040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.906764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:55.907116 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.908703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.921718 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1412/2810] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:56:55.926105 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:55.935509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456963f9-e6d3-4c0b-ba4a-69c86d68722c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:55.940187 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:55.940825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:55.941108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:55.941385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:55.942094 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:55.943983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:55.949245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:56.056383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1413/2811] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:55 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:56.058181 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.079259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:56.079259 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514fdfc40d454ef69219530911b0cbdf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:56.096003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514fdfc40d454ef69219530911b0cbdf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:56.105080 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514fdfc40d454ef69219530911b0cbdf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:56.106228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514fdfc40d454ef69219530911b0cbdf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:56.106863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-eeca5a4c-0059-435d-acd7-2832419a8e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514fdfc40d454ef69219530911b0cbdf'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:56.126499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235966f3-3d2b-4c58-b327-ce8c5aa242d3 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.131697 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.132366 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.132651 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.132927 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.133612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.135810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.241037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1414/2812] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:56 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:56.241276 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1399/2813] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:55 2022] DELETE /identity/v3/users/514fdfc40d454ef69219530911b0cbdf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:56.244983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.246186 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.246488 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.246662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:56.246777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.260186 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d7c28-88ab-40b5-9bc8-d3cb029a206c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.266786 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:56.268003 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:56.317573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.318273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.318557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.318834 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.319557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.321146 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.326162 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1400/2814] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:56.335435 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1415/2815] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:56.339261 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.339759 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.341523 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:56.349741 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f05d0-5013-4ee0-a33b-ea7f7cf20f3f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.354531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.355068 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.355356 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.355638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.356346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.357941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.371157 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1416/2816] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:56:56.372383 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.383228 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981a85e-21e7-4333-802c-61d721416781 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.388123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.388979 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.389260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.389536 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] PATH_INFO: `/v3/projects/64afafc774a24936a554b9516496b77f/users/709d0dd0836948aeac4690d7cd567d4d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.399756 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3268e30-2c8d-4ec2-9b1a-64431583b165 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.403497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.404155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.404444 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.404723 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.406647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64afafc774a24936a554b9516496b77f, user_id=709d0dd0836948aeac4690d7cd567d4d, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.409344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.414607 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.416037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03118f0-09f0-47f0-9c46-d6b8e07d2f5e service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.425653 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1401/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:56:56.496017 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1417/2818] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:56 2022] PUT /identity/v3/projects/64afafc774a24936a554b9516496b77f/users/709d0dd0836948aeac4690d7cd567d4d/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:56.506743 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.507103 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.507454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.534877 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] MFA Rules not processed for user `709d0dd0836948aeac4690d7cd567d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:56.537613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:56.593516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:56.602657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1402/2819] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:56.614396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.616268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:56.667427 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:56.686948 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8c418-5ccb-474d-ac0b-bfb8cfd8821f admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:56.687713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:56.688368 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:56.688654 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:56.688934 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:56.698277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:56.699713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:56.710009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1418/2820] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:56:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:56:56.961724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:56.963205 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:57.030657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96578a9-4590-476d-bb39-d1abc5ecc621 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:57.035976 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:57.036845 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:57.037175 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:57.037454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] PATH_INFO: `/v3/projects/0101425f60a74217b816715002f86052` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:57.038713 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0101425f60a74217b816715002f86052)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:57.040599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:57.160256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0101425f60a74217b816715002f86052', 'request_id': 'req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.166027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0101425f60a74217b816715002f86052', 'request_id': 'req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.226922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0101425f60a74217b816715002f86052', 'request_id': 'req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.238155 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] The token cache is being invalidate because project 0101425f60a74217b816715002f86052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:57.238440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.239650 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.241226 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1403/2821] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:56 2022] DELETE /identity/v3/projects/0101425f60a74217b816715002f86052 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:57.245272 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:57.255795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30896-6a8a-41e5-abf9-4be6698ef30b service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:57.316363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:57.317245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:57.317526 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:57.317800 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] PATH_INFO: `/v3/users/66bf41dad53b4146b3e90dcb1c3fc55e` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:57.319107 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66bf41dad53b4146b3e90dcb1c3fc55e)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:57.321122 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:57.526510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66bf41dad53b4146b3e90dcb1c3fc55e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.540355 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66bf41dad53b4146b3e90dcb1c3fc55e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.651717 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66bf41dad53b4146b3e90dcb1c3fc55e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.652408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66bf41dad53b4146b3e90dcb1c3fc55e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.660258 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-655590d2-5336-4059-a0ad-0eb59dbabdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66bf41dad53b4146b3e90dcb1c3fc55e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:57.666270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1419/2822] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:57 2022] DELETE /identity/v3/users/66bf41dad53b4146b3e90dcb1c3fc55e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:58.088480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:58.088480 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:58.101200 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268919e-f8b6-4cd6-97c4-2e6cfb20e67e admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:58.167967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:58.168856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.169138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.169409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] PATH_INFO: `/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.170636 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca3ff8878f5d4cc4a5239fdbf7c8afff)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:58.172555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:58.357358 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:58.373206 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca3ff8878f5d4cc4a5239fdbf7c8afff', 'request_id': 'req-0b42a4c7-243e-498f-a230-5a39a3daf97d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:58.378817 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca3ff8878f5d4cc4a5239fdbf7c8afff', 'request_id': 'req-0b42a4c7-243e-498f-a230-5a39a3daf97d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:58.445439 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca3ff8878f5d4cc4a5239fdbf7c8afff', 'request_id': 'req-0b42a4c7-243e-498f-a230-5a39a3daf97d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:58.456749 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] The token cache is being invalidate because project ca3ff8878f5d4cc4a5239fdbf7c8afff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:56:58.457196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:58.457816 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-0b42a4c7-243e-498f-a230-5a39a3daf97d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:56:58.459602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1404/2823] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:56:58 2022] DELETE /identity/v3/projects/ca3ff8878f5d4cc4a5239fdbf7c8afff => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:58.464612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.466498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.466498 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.483222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:58.484549 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:58.548937 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:58.553466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1420/2824] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:58.562196 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d88-929c-440d-93c0-b883d412431f None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.562517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d88-929c-440d-93c0-b883d412431f None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.562846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06905d88-929c-440d-93c0-b883d412431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.585648 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-06905d88-929c-440d-93c0-b883d412431f None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:58.586955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-06905d88-929c-440d-93c0-b883d412431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:58.598337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1405/2825] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:58.608893 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:58.612067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3f520-d30c-45c2-b08e-ccf37ad301a8 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:58.617928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:58.618587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.618875 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.619149 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.619876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:56:58.620182 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:58.621821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:58.633890 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1421/2826] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:56:58.638777 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905d88-929c-440d-93c0-b883d412431f None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:58.648262 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06905d88-929c-440d-93c0-b883d412431f None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:58.653341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:58.654050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.654341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.654619 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.655311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:58.657218 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:58.791302 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1406/2827] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:58 2022] POST /identity/v3/projects => generated 393 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:58.795466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:58.805339 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73146e-4385-4720-9cea-d543dbd06b19 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:58.862764 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:58.863413 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:58.863694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:58.864249 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:58.864936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:58.867044 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.002708 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1422/2828] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:58 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:59.005150 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.016387 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ceda57-bb9f-405c-a9a7-0d229220bf35 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.023124 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.023783 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.024071 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.024366 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.025082 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.026742 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.037578 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1407/2829] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:59.041745 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.052174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58126678-cf99-4a14-8423-9bb2f9395e86 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.057557 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.062023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.062023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.062023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.062023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.062023 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08678a2-7fec-41a7-ba4e-a06fd798d7fd admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.072236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1423/2830] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:59.076219 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.086888 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab7c44-aa70-4e09-8a8d-1227cf8fab13 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.090778 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.091645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.091927 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.092201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] PATH_INFO: `/v3/projects/e4a1c54df4f141d5ab7aa4ea21d2f482/users/89a38cbb1626440db91eb4525f583f77/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.106923 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4a1c54df4f141d5ab7aa4ea21d2f482, user_id=89a38cbb1626440db91eb4525f583f77, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.109546 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.241211 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1408/2831] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:59 2022] PUT /identity/v3/projects/e4a1c54df4f141d5ab7aa4ea21d2f482/users/89a38cbb1626440db91eb4525f583f77/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:56:59.251360 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.258928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.258928 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.278032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] MFA Rules not processed for user `89a38cbb1626440db91eb4525f583f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:56:59.279298 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:59.343224 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1424/2832] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:56:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:56:59.348450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.425613 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f7ce7-60a6-4332-9065-0ce8dc776b56 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.431021 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.431684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.431973 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.432254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.432948 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.434878 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.543511 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1409/2833] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:56:59 2022] POST /identity/v3/projects => generated 393 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:56:59.547527 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.558083 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ae2cb-fecb-4bde-a1be-f5aa33898a70 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.607595 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:56:59.614237 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.614903 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.615192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.615473 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.616230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.618193 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.795404 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1425/2834] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:56:59 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:56:59.799462 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.809867 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b099eca-3dd3-4952-bff3-d78b5290fdc7 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.814453 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.815109 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.815394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.815672 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.816390 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.818011 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.831092 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1410/2835] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:56:59.838503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.848518 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc40b5-f258-48ad-9e0a-76b9c11fe243 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:56:59.853725 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:56:59.854679 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:56:59.854962 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:56:59.855234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] PATH_INFO: `/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd/users/9d9cb07478b14788bf1fd45ecfe71ca2/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:56:59.869837 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2d71bf45644cb3ab2a13866ee8bddd, user_id=9d9cb07478b14788bf1fd45ecfe71ca2, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:56:59.872394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:56:59.955702 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1426/2836] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:56:59 2022] PUT /identity/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd/users/9d9cb07478b14788bf1fd45ecfe71ca2/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:56:59.959614 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.960250 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:56:59.961344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:56:59.975631 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b87e9a-710f-4837-9d8a-9b9b7f52e83a admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.002485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:00.032779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb378c5f-9660-4d08-bf1b-b63e622e3183 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.035879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.036765 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.037110 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.037391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] PATH_INFO: `/v3/users/0f47baa8cfc8492aaf3184079c654cc4` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.037918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.038556 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.040884 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f47baa8cfc8492aaf3184079c654cc4)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.041057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.041057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.041057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.041310 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.041400 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.051537 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1427/2837] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:56:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:57:00.055766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:00.065338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1322844-7d0a-4958-afe7-e3c18f088ceb admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.071015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.071888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.072174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.072450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] PATH_INFO: `/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd/users/9d9cb07478b14788bf1fd45ecfe71ca2/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.074551 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d2d71bf45644cb3ab2a13866ee8bddd, user_id=9d9cb07478b14788bf1fd45ecfe71ca2, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.077200 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54259-bbef-4e0a-ae29-68b338a843ce admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.088226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1428/2838] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:00 2022] PUT /identity/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd/users/9d9cb07478b14788bf1fd45ecfe71ca2/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:00.098225 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.098507 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.098787 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.125843 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] MFA Rules not processed for user `9d9cb07478b14788bf1fd45ecfe71ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:00.127006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.194888 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1429/2839] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:57:00.205394 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:00.206726 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.237810 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:00.258485 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f47baa8cfc8492aaf3184079c654cc4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:00.264018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19beea-e133-46de-bf97-c2bcfcea7da0 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.267853 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.268573 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.268861 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.269138 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.271495 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f47baa8cfc8492aaf3184079c654cc4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:00.278769 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.278905 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f47baa8cfc8492aaf3184079c654cc4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:00.279569 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f47baa8cfc8492aaf3184079c654cc4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:00.280184 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e6aaebe7-a565-44b2-8f50-be75ea809c9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f47baa8cfc8492aaf3184079c654cc4'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:00.280363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.289739 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1430/2840] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:57:00.335050 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:00.339236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.347760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54170fb0-f5ad-4115-972d-080085ef0b8d service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.351489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.352121 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.352403 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.352682 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.354450 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.399015 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1411/2841] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:56:59 2022] DELETE /identity/v3/users/0f47baa8cfc8492aaf3184079c654cc4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:00.403148 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.403437 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.403746 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.416175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.417602 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.422243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:00.424215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.428155 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1431/2842] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:57:00.491267 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1412/2843] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:57:00.504294 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:00.506577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:00.591534 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc13aa-db3c-464b-a511-5485fe3f9bdd service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:00.645203 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:00.645882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:00.646177 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:00.646453 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:00.656236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:00.657592 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:00.667558 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1432/2844] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:01.159897 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:01.161535 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:01.188072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cbaf84-b174-4f5b-9d77-7d0d7c5ec680 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:01.194847 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:01.195715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:01.195997 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:01.196273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] PATH_INFO: `/v3/projects/bb4950164d0747328cc51403c0e1362c` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:01.197458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4950164d0747328cc51403c0e1362c)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:01.199426 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:01.350651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:01.358191 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4950164d0747328cc51403c0e1362c', 'request_id': 'req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:01.392689 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4950164d0747328cc51403c0e1362c', 'request_id': 'req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:01.548435 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4950164d0747328cc51403c0e1362c', 'request_id': 'req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:01.560330 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] The token cache is being invalidate because project bb4950164d0747328cc51403c0e1362c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:01.560660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:01.561651 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:01.564379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1413/2845] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:01 2022] DELETE /identity/v3/projects/bb4950164d0747328cc51403c0e1362c => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:01.567309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:01.577662 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b8229-263d-42f7-b9d3-a7cc77aeff0f service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:01.606703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:01.637804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:01.638713 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:01.638999 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:01.639277 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] PATH_INFO: `/v3/users/740b8b8d49314e75911588735db51f32` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:01.640466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=740b8b8d49314e75911588735db51f32)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:01.642440 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:02.003234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740b8b8d49314e75911588735db51f32'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.015857 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740b8b8d49314e75911588735db51f32'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.102580 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740b8b8d49314e75911588735db51f32'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.103363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740b8b8d49314e75911588735db51f32'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.110825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740b8b8d49314e75911588735db51f32'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.117548 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1433/2846] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:01 2022] DELETE /identity/v3/users/740b8b8d49314e75911588735db51f32 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:02.573421 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:02.575693 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:02.591207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8270c-0398-4a32-91e7-7aa9873d4d6b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:02.648603 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:02.649448 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:02.649729 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:02.650033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] PATH_INFO: `/v3/projects/fc4e792cc10b40f29fbcbc17d7173b1b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:02.651242 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4e792cc10b40f29fbcbc17d7173b1b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:02.653128 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:02.827049 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4e792cc10b40f29fbcbc17d7173b1b', 'request_id': 'req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.832280 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4e792cc10b40f29fbcbc17d7173b1b', 'request_id': 'req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.948149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4e792cc10b40f29fbcbc17d7173b1b', 'request_id': 'req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.959320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] The token cache is being invalidate because project fc4e792cc10b40f29fbcbc17d7173b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:02.959599 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.960223 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:02.961762 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1414/2847] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:02 2022] DELETE /identity/v3/projects/fc4e792cc10b40f29fbcbc17d7173b1b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:02.965731 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:02.967804 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:02.980365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c28efb-d02f-4f6a-8cba-a30a705eae2b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:03.036030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:03.036891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:03.037683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:03.038000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] PATH_INFO: `/v3/users/1f388639fa8b461bb7e2ea5e4e6340a9` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:03.042268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f388639fa8b461bb7e2ea5e4e6340a9)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:03.042268 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:03.245247 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f388639fa8b461bb7e2ea5e4e6340a9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:03.247130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:03.257915 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f388639fa8b461bb7e2ea5e4e6340a9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:03.342791 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f388639fa8b461bb7e2ea5e4e6340a9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:03.343401 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f388639fa8b461bb7e2ea5e4e6340a9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:03.352091 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f388639fa8b461bb7e2ea5e4e6340a9'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:03.358382 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1434/2848] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:02 2022] DELETE /identity/v3/users/1f388639fa8b461bb7e2ea5e4e6340a9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:03.895684 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:03.896896 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:03.918000 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad98409-b69b-4d04-9d8b-c9c9a6e6c931 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:04.004829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:04.005916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:04.006224 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:04.006572 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] PATH_INFO: `/v3/projects/8df988e2b7f54bf8b36152db37919201` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:04.008383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df988e2b7f54bf8b36152db37919201)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:04.010863 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:04.012616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:04.137454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df988e2b7f54bf8b36152db37919201', 'request_id': 'req-63acec2e-6a1c-438e-acd8-2a8d230df0a0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:04.142935 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df988e2b7f54bf8b36152db37919201', 'request_id': 'req-63acec2e-6a1c-438e-acd8-2a8d230df0a0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:04.244086 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df988e2b7f54bf8b36152db37919201', 'request_id': 'req-63acec2e-6a1c-438e-acd8-2a8d230df0a0'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:04.256051 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] The token cache is being invalidate because project 8df988e2b7f54bf8b36152db37919201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:04.256571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:04.258090 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-63acec2e-6a1c-438e-acd8-2a8d230df0a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:04.260522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1415/2849] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:03 2022] DELETE /identity/v3/projects/8df988e2b7f54bf8b36152db37919201 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:06.870481 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:06.871939 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:06.884830 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cef5ea-d7aa-4f91-a163-2bdca002cd59 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:06.941040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:06.941941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:06.942226 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:06.942503 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] PATH_INFO: `/v3/users/89a38cbb1626440db91eb4525f583f77` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:06.943683 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a38cbb1626440db91eb4525f583f77)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:06.945615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:07.190631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a38cbb1626440db91eb4525f583f77'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:07.202361 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a38cbb1626440db91eb4525f583f77'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:07.295385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a38cbb1626440db91eb4525f583f77'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:07.296032 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a38cbb1626440db91eb4525f583f77'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:07.303594 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a38cbb1626440db91eb4525f583f77'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:07.309590 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1435/2850] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:06 2022] DELETE /identity/v3/users/89a38cbb1626440db91eb4525f583f77 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:07.313958 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:07.314412 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:07.314510 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:07.332288 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:07.338134 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:07.395589 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1416/2851] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:07.405807 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:07.407234 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:07.459509 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:07.465377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f77291-5db5-4bd3-bb78-0dd075bccc96 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:07.469054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:07.469690 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:07.470008 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:07.470282 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:07.479184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:07.480599 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:07.490012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1436/2852] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:07.988496 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:07.990072 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:08.004606 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631e2a7-323f-475d-ad69-ca97432dfad7 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:08.009423 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:08.010581 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:08.010869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:08.011154 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] PATH_INFO: `/v3/projects/e4a1c54df4f141d5ab7aa4ea21d2f482` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:08.012354 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4a1c54df4f141d5ab7aa4ea21d2f482)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:08.014391 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:08.138324 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4a1c54df4f141d5ab7aa4ea21d2f482', 'request_id': 'req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.143711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4a1c54df4f141d5ab7aa4ea21d2f482', 'request_id': 'req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.302840 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4a1c54df4f141d5ab7aa4ea21d2f482', 'request_id': 'req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.316348 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] The token cache is being invalidate because project e4a1c54df4f141d5ab7aa4ea21d2f482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:08.316943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.317337 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.319139 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1417/2853] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:07 2022] DELETE /identity/v3/projects/e4a1c54df4f141d5ab7aa4ea21d2f482 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:08.323615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:08.334133 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5bf08-3f75-461d-a153-0c709da2f552 service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:08.390902 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:08.391779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:08.392061 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:08.392337 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] PATH_INFO: `/v3/users/9d9cb07478b14788bf1fd45ecfe71ca2` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:08.393522 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9cb07478b14788bf1fd45ecfe71ca2)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:08.395467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:08.613057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9cb07478b14788bf1fd45ecfe71ca2'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.625302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9cb07478b14788bf1fd45ecfe71ca2'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.740758 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9cb07478b14788bf1fd45ecfe71ca2'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.741381 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9cb07478b14788bf1fd45ecfe71ca2'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.750195 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-067a639e-69c5-48bb-ba61-b5c21d15ac94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9cb07478b14788bf1fd45ecfe71ca2'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:08.756243 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1437/2854] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:08 2022] DELETE /identity/v3/users/9d9cb07478b14788bf1fd45ecfe71ca2 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:09.277517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:09.277517 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:09.285571 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd9e91-617a-45dd-a0ba-1ac3567a48ae admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:09.295459 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:09.342570 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:09.343432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.343716 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.343993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] PATH_INFO: `/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.345167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d2d71bf45644cb3ab2a13866ee8bddd)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:09.347105 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:09.469490 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d2d71bf45644cb3ab2a13866ee8bddd', 'request_id': 'req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.474942 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d2d71bf45644cb3ab2a13866ee8bddd', 'request_id': 'req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.593706 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d2d71bf45644cb3ab2a13866ee8bddd', 'request_id': 'req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.605329 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] The token cache is being invalidate because project 2d2d71bf45644cb3ab2a13866ee8bddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:09.605623 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.606285 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.608089 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1418/2855] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:09 2022] DELETE /identity/v3/projects/2d2d71bf45644cb3ab2a13866ee8bddd => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:09.613263 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708567-3e14-48a9-a78f-297f6e19c2d3 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.613703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708567-3e14-48a9-a78f-297f6e19c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.614545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708567-3e14-48a9-a78f-297f6e19c2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.614657 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:09.615996 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:09.633184 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-fa708567-3e14-48a9-a78f-297f6e19c2d3 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:09.634425 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-fa708567-3e14-48a9-a78f-297f6e19c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:09.680922 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4181f86-95ec-4bd9-bc57-c86d2d58e8ec admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:09.685813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:09.686717 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.687009 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.687290 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] PATH_INFO: `/v3/users/709d0dd0836948aeac4690d7cd567d4d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.688516 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=709d0dd0836948aeac4690d7cd567d4d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:09.690483 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:09.695510 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1438/2856] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:09.704311 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.704880 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.705408 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.726906 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:09.728037 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:09.736102 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1439/2857] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:57:09.740112 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:09.744281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:09.749699 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b902e-2a94-484d-9be0-45e851b16685 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:09.754331 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:09.757833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.757833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.757833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.757833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80792) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:57:09.757833 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:09.758719 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:09.771667 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1440/2858] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 03:57:09.776749 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:09.786665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4cc45-4a5c-4e74-a31d-1a2dc626a610 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:09.791377 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:09.792011 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.792296 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.792574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.793254 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:09.795202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:09.890852 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:09.892454 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '709d0dd0836948aeac4690d7cd567d4d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.904747 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '709d0dd0836948aeac4690d7cd567d4d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.911519 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '709d0dd0836948aeac4690d7cd567d4d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.912284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '709d0dd0836948aeac4690d7cd567d4d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.912917 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-be90b846-22cf-44b4-aeb5-6b3f49cf62f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '709d0dd0836948aeac4690d7cd567d4d'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:09.919983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1441/2859] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:57:09 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:57:09.924004 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:09.925694 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:09.987728 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8743117-bee2-422e-81ae-be46cadcb09c admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:09.992847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:09.993511 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:09.993797 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:09.994104 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:09.994794 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:09.996705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.044287 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1419/2860] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:09 2022] DELETE /identity/v3/users/709d0dd0836948aeac4690d7cd567d4d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:10.048664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.048952 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.049228 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.066465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:10.067733 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:10.121421 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1442/2861] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:57:09 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:57:10.124933 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1420/2862] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 03:57:10.125701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.135300 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.136638 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:10.136975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd37bc-4b77-43c1-9dc1-8a526ed04f22 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.141644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.142326 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.142615 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.142891 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.143609 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.145202 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.157475 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1443/2863] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:57:10.170587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.181434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27159c0c-6e9d-4392-ace7-17a3b928fc65 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.186174 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.186806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.187117 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.187390 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.188098 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.189661 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.196101 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a27bbf7-375f-49ed-ab96-1b6cde22ebab None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.199903 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.200434 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1444/2864] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:57:10.200660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.200946 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.201253 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.204495 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.211050 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.212497 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1c060-4f42-4367-b329-b61dd6c009bd service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.214917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b74af9-8eae-4c12-86c1-4d759e66708d admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.219629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.220472 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.220754 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.221030 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] PATH_INFO: `/v3/projects/a5a5e94850954f2c901c744bf9102ad1/users/252ba4a23df7466b8e09cb08dd96524f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.222371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1421/2865] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:10.236073 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5a5e94850954f2c901c744bf9102ad1, user_id=252ba4a23df7466b8e09cb08dd96524f, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.238770 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.377387 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1445/2866] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:10 2022] PUT /identity/v3/projects/a5a5e94850954f2c901c744bf9102ad1/users/252ba4a23df7466b8e09cb08dd96524f/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:57:10.388138 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.388635 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.388773 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.415620 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] MFA Rules not processed for user `252ba4a23df7466b8e09cb08dd96524f`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:10.416846 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:10.477647 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:10.486720 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1422/2867] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:10.491108 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.558000 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f73c5d-9993-4f1d-8d1a-9a23dd81e96e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.562703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.563374 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.563657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.563936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.564644 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.566588 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.582304 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:10.667502 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.669904 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1446/2868] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:57:10 2022] POST /identity/v3/projects => generated 401 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:57:10.670993 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:10.674855 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.687190 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfadbe-2797-40a0-bcf5-79cc483d81d6 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.749674 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.750586 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.750872 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.751151 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] PATH_INFO: `/v3/projects/64afafc774a24936a554b9516496b77f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.752398 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64afafc774a24936a554b9516496b77f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.754246 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be810461-9160-45e8-96e6-34362049b535 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.758471 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.759860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.760785 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.761067 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.761341 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] PATH_INFO: `/v3/users` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.762059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.763968 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.863585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1447/2869] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:57:10 2022] POST /identity/v3/users => generated 307 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:57:10.867578 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.877048 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef357a-5de6-43f8-9c61-d71c6b8ce85e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.881705 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.882370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.882657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.882933 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.883646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.885461 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:10.895212 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1448/2870] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:57:10.899646 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:10.909260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a1e9-8c46-4bc1-92f5-150b38ad5661 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:10.915682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64afafc774a24936a554b9516496b77f', 'request_id': 'req-711bdef4-bafe-4b41-92a8-f5412e066955'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:10.921189 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64afafc774a24936a554b9516496b77f', 'request_id': 'req-711bdef4-bafe-4b41-92a8-f5412e066955'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:10.966062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:10.966936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:10.967222 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:10.967499 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] PATH_INFO: `/v3/projects/c761502d0e8e470aa918cc253f08ee2c/users/101e3553b842433da8917cf04d674a33/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:10.982230 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c761502d0e8e470aa918cc253f08ee2c, user_id=101e3553b842433da8917cf04d674a33, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:10.984847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:11.011915 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64afafc774a24936a554b9516496b77f', 'request_id': 'req-711bdef4-bafe-4b41-92a8-f5412e066955'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:11.024097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] The token cache is being invalidate because project 64afafc774a24936a554b9516496b77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80791) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:11.027508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:11.027508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:11.027508 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1423/2871] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:10 2022] DELETE /identity/v3/projects/64afafc774a24936a554b9516496b77f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:11.110018 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1449/2872] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:10 2022] PUT /identity/v3/projects/c761502d0e8e470aa918cc253f08ee2c/users/101e3553b842433da8917cf04d674a33/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:11.114231 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:11.115752 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:11.128999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bdef4-bafe-4b41-92a8-f5412e066955 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:11.189479 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:11.190198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:11.190489 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:11.190767 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:11.191509 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:11.193167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1fb69-0f76-4577-8490-8a62235da333 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:11.204890 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1424/2873] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:57:11.209657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:11.221941 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccc930-53e0-445a-9515-fb6853f646af admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:11.226825 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:11.227735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:11.228025 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:11.228305 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] PATH_INFO: `/v3/projects/c761502d0e8e470aa918cc253f08ee2c/users/101e3553b842433da8917cf04d674a33/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:11.230407 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c761502d0e8e470aa918cc253f08ee2c, user_id=101e3553b842433da8917cf04d674a33, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:11.233114 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:11.245012 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1450/2874] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:11 2022] PUT /identity/v3/projects/c761502d0e8e470aa918cc253f08ee2c/users/101e3553b842433da8917cf04d674a33/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:11.256906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:11.257120 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:11.257914 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:11.285920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] MFA Rules not processed for user `101e3553b842433da8917cf04d674a33`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:11.287201 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:11.296408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:11.354592 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1425/2875] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:11.365164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:11.369841 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:11.414343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:11.424944 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be6d5e-8d07-472b-a844-cfba83fe6026 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:11.428643 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:11.429775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:11.430106 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:11.430365 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:11.439346 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:11.440760 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:11.450887 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1451/2876] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:11.738551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:11.749033 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3083414-2488-4e55-bb5f-bbeaad814171 None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:11.752798 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:11.753383 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:11.753671 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:11.753980 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:11.755768 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:11.815536 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:11.816964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:11.825967 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1426/2877] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:12.723076 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:12.724528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:12.781951 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2cf2e0-d62c-46f0-a474-366cc205de8d service cinder] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:12.785560 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:12.786236 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:12.786581 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:12.786860 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:12.788629 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:12.798147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:12.799582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c25247-d45a-4805-86f3-8f1591032978 service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:12.807652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1452/2878] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:16.888524 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:16.949443 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af797147-e171-49fe-9c89-2483c49751dd service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:16.954032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:16.954891 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:16.955170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:16.955440 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] PATH_INFO: `/v3/users/252ba4a23df7466b8e09cb08dd96524f` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:16.956616 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=252ba4a23df7466b8e09cb08dd96524f)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:16.958538 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:17.154394 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252ba4a23df7466b8e09cb08dd96524f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:17.155432 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:17.166281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252ba4a23df7466b8e09cb08dd96524f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:17.172999 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252ba4a23df7466b8e09cb08dd96524f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:17.173687 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252ba4a23df7466b8e09cb08dd96524f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:17.174320 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252ba4a23df7466b8e09cb08dd96524f'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:17.265801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1427/2879] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:16 2022] DELETE /identity/v3/users/252ba4a23df7466b8e09cb08dd96524f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:17.270302 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:17.270763 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:17.270862 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:17.288956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:17.290248 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:17.348342 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1453/2880] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:17.357968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:17.359373 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:17.416079 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad630292-f373-4245-ad3c-9767fc0d7c9b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:17.419710 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:17.420347 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:17.420639 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:17.420916 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:17.430408 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:17.431829 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:17.441169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1428/2881] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:17.870189 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:17.871636 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:17.884406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bcba3-9e25-458f-b358-a4deb25015f5 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:17.889386 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:17.890293 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:17.890577 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:17.890851 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] PATH_INFO: `/v3/projects/a5a5e94850954f2c901c744bf9102ad1` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:17.892049 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5a5e94850954f2c901c744bf9102ad1)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:17.894058 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:18.057920 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5a5e94850954f2c901c744bf9102ad1', 'request_id': 'req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.064175 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5a5e94850954f2c901c744bf9102ad1', 'request_id': 'req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.159659 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5a5e94850954f2c901c744bf9102ad1', 'request_id': 'req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.170882 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] The token cache is being invalidate because project a5a5e94850954f2c901c744bf9102ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:18.171757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.171757 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.173309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1454/2882] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:17 2022] DELETE /identity/v3/projects/a5a5e94850954f2c901c744bf9102ad1 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:18.177281 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:18.187602 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02485aed-485f-4fda-b43f-ed9ed949c097 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:18.243127 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:18.243991 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:18.244279 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:18.244558 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] PATH_INFO: `/v3/users/101e3553b842433da8917cf04d674a33` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:18.245735 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101e3553b842433da8917cf04d674a33)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:18.247663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:18.390198 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101e3553b842433da8917cf04d674a33'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.402540 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101e3553b842433da8917cf04d674a33'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.407035 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:18.409880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101e3553b842433da8917cf04d674a33'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.410559 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101e3553b842433da8917cf04d674a33'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.411169 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-e5880051-c544-4e24-8489-258d265e66f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101e3553b842433da8917cf04d674a33'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:18.473237 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1429/2883] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:18 2022] DELETE /identity/v3/users/101e3553b842433da8917cf04d674a33 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 03:57:18.881238 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:18.883297 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:18.896535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2ae10-e1b5-4e6b-84f6-57233f6a0ae7 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:18.906443 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:18.954333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:18.955123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:18.955409 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:18.955684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] PATH_INFO: `/v3/projects/c761502d0e8e470aa918cc253f08ee2c` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:18.956895 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c761502d0e8e470aa918cc253f08ee2c)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:18.958821 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.086393 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c761502d0e8e470aa918cc253f08ee2c', 'request_id': 'req-150fe5e5-eef2-4294-8e5e-49cdca922819'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:19.092514 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c761502d0e8e470aa918cc253f08ee2c', 'request_id': 'req-150fe5e5-eef2-4294-8e5e-49cdca922819'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:19.174665 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c761502d0e8e470aa918cc253f08ee2c', 'request_id': 'req-150fe5e5-eef2-4294-8e5e-49cdca922819'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:19.186354 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] The token cache is being invalidate because project c761502d0e8e470aa918cc253f08ee2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:19.186638 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:19.187260 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-150fe5e5-eef2-4294-8e5e-49cdca922819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:19.188798 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1455/2884] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:18 2022] DELETE /identity/v3/projects/c761502d0e8e470aa918cc253f08ee2c => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:19.193744 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.194233 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.194359 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.212712 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:19.213929 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:19.271920 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1430/2885] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:19.279766 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.280062 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.280344 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.298852 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:19.300054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:19.308684 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1456/2886] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:19.312660 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.322458 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a65a3a-fd9e-4480-bde5-03300c7016fe None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.327166 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.327813 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.328097 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.328377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.329100 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80791) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 03:57:19.329409 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.331047 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.342533 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1431/2887] 10.222.0.42 () {58 vars in 1152 bytes} [Fri Jun 24 03:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 03:57:19.346572 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.356411 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43df1e4-9c26-47e8-b448-31673f5f2242 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.361028 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.361656 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.361982 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.362253 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.362936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.364802 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.440795 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1457/2888] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:57:19.445164 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.455140 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81c9413-80f5-41ed-adad-f8021ac49ad1 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.511641 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.512236 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.512522 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.512800 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.513494 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.515442 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.639950 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1432/2889] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 03:57:19.643975 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.654231 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f25acc-1f54-4a5d-87f5-9315feb67e1b admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.658972 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.659625 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.659908 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.660183 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.660907 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.662519 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.673333 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1458/2890] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 03:57:19.677192 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.687680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54cae5-a748-40b4-b48c-9a189e6ffece admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.692306 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.692955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.693240 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.693515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.694269 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.695873 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e863135-5959-46ee-80f8-02d521116cf2 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.705711 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1433/2891] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:57:19.709671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.720130 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292a964-a58a-419c-98de-5f18af3042fa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:19.724854 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:19.726370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.726657 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.726936 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] PATH_INFO: `/v3/projects/d30ecf0f8ce443b7b8312189380afacd/users/aace55db88444c0aa534f97a3c505d96/roles/9c65cdf40d6b4cd7ae29835be0fb90b8` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.741385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30ecf0f8ce443b7b8312189380afacd, user_id=aace55db88444c0aa534f97a3c505d96, role_id=9c65cdf40d6b4cd7ae29835be0fb90b8)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:19.744109 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:19.834467 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1459/2892] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:19 2022] PUT /identity/v3/projects/d30ecf0f8ce443b7b8312189380afacd/users/aace55db88444c0aa534f97a3c505d96/roles/9c65cdf40d6b4cd7ae29835be0fb90b8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:19.845249 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:19.845543 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:19.845830 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:19.872573 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.auth.core [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] MFA Rules not processed for user `aace55db88444c0aa534f97a3c505d96`. Rule list: `[]` (Enabled: `True`). {{(pid=80791) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:19.873789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:19.915065 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:19.938257 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1434/2893] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:19.942500 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:19.986213 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:20.005347 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68e293-8ceb-4d3c-ad20-eb48545bad41 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.010396 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.011054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.011338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.011613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.012338 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.014264 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.189064 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1460/2894] 10.222.0.42 () {60 vars in 1152 bytes} [Fri Jun 24 03:57:19 2022] POST /identity/v3/projects => generated 381 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:57:20.193431 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.204149 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0224f376-f5a9-4c62-870f-e1de1a3b31cf None None] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.260924 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.261577 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] REQUEST_METHOD: `POST` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.261879 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.262170 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] PATH_INFO: `/v3/users` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.262856 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.264760 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.371645 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1435/2895] 10.222.0.42 () {60 vars in 1143 bytes} [Fri Jun 24 03:57:20 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 03:57:20.375613 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.386363 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ced6be-9ae8-4406-89da-24cdac2c5ad5 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.391015 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.391670 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.391956 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.392235 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.392957 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.394587 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.405009 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1461/2896] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:57:20.409044 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.419379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c915486-d8b7-40a5-9b1d-31ba3793ec94 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.424187 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.425058 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.425339 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.425610 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] PATH_INFO: `/v3/projects/5d91248961fd4e1b96ba6bed200aafd1/users/28cbf49d703d417fbb74b3221e8fde9b/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.440880 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d91248961fd4e1b96ba6bed200aafd1, user_id=28cbf49d703d417fbb74b3221e8fde9b, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.443484 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.513964 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1436/2897] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:20 2022] PUT /identity/v3/projects/5d91248961fd4e1b96ba6bed200aafd1/users/28cbf49d703d417fbb74b3221e8fde9b/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:20.517779 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.528649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9c33d-5ecf-4735-be1b-ff668a6b0eaa admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.589129 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.589801 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.590136 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.590416 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.591137 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.592824 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391e1f0-e316-4739-b13c-cf997685eb5b admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.603343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1462/2898] 10.222.0.42 () {58 vars in 1121 bytes} [Fri Jun 24 03:57:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 03:57:20.607575 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.618215 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c9a4d-0bea-41b3-a852-06cd7dd01591 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.622943 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.623820 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] REQUEST_METHOD: `PUT` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.624106 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.624382 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] PATH_INFO: `/v3/projects/5d91248961fd4e1b96ba6bed200aafd1/users/28cbf49d703d417fbb74b3221e8fde9b/roles/20658940146144b9b9afa747f31d7a5d` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.626422 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d91248961fd4e1b96ba6bed200aafd1, user_id=28cbf49d703d417fbb74b3221e8fde9b, role_id=20658940146144b9b9afa747f31d7a5d)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.629132 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.639794 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1437/2899] 10.222.0.42 () {60 vars in 1482 bytes} [Fri Jun 24 03:57:20 2022] PUT /identity/v3/projects/5d91248961fd4e1b96ba6bed200aafd1/users/28cbf49d703d417fbb74b3221e8fde9b/roles/20658940146144b9b9afa747f31d7a5d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:20.704631 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.704926 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.705209 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.732406 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] MFA Rules not processed for user `28cbf49d703d417fbb74b3221e8fde9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:20.733671 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:20.802650 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1463/2900] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:20.813775 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:20.815468 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:20.871379 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781df0b8-d700-4a65-92a3-fb5dced3638d admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:20.875032 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:20.875663 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:20.875947 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:20.876217 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:20.885083 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:20.886761 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:20.896153 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1438/2901] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:20.994641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:21.004460 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc185f-98ac-488b-99f6-bad5a69f796e None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:21.008003 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb1e0a3ad767472cafc4ce0ede2f6a03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:21.008637 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:21.008917 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:21.009192 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:21.042313 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:21.067162 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:21.068622 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8704c7-4096-4990-9b42-ecbae7e17aff service cinder] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:21.078211 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1464/2902] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:24.251834 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:24.293057 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:24.314364 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2666ef-6e69-48ba-9db3-a6d38e2ca64d service cinder] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:24.318909 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:24.319755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:24.320037 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:24.320311 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] PATH_INFO: `/v3/users/aace55db88444c0aa534f97a3c505d96` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:24.321515 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aace55db88444c0aa534f97a3c505d96)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:24.323452 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:24.555554 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aace55db88444c0aa534f97a3c505d96'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:24.567555 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aace55db88444c0aa534f97a3c505d96'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:24.574955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aace55db88444c0aa534f97a3c505d96'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:24.575611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aace55db88444c0aa534f97a3c505d96'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:24.576207 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aace55db88444c0aa534f97a3c505d96'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:24.661869 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1439/2903] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:24 2022] DELETE /identity/v3/users/aace55db88444c0aa534f97a3c505d96 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:24.666446 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] REQUEST_METHOD: `POST` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:24.666949 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:24.667057 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:24.683775 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.auth.core [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] MFA Rules not processed for user `2caa6cb9210e46f2a79af594aec8b818`. Rule list: `[]` (Enabled: `True`). {{(pid=80792) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 03:57:24.685059 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:24.744502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1465/2904] 10.222.0.42 () {58 vars in 957 bytes} [Fri Jun 24 03:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 03:57:24.761167 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:24.762618 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:24.818823 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f801e-3875-47e5-a6d7-85109888d42f admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:24.822844 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:24.823478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:24.823759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:24.824034 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:24.833789 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:24.836112 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:24.845801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1440/2905] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:25.246983 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:25.248455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:25.261013 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45349e8-5521-46b8-9a08-f89f87f41e92 None None] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:25.266385 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:25.267252 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:25.267531 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:25.267809 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] PATH_INFO: `/v3/projects/d30ecf0f8ce443b7b8312189380afacd` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:25.269026 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30ecf0f8ce443b7b8312189380afacd)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:25.270984 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:25.386147 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30ecf0f8ce443b7b8312189380afacd', 'request_id': 'req-b371198e-9372-4b6b-bfac-209e5950c188'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.392270 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30ecf0f8ce443b7b8312189380afacd', 'request_id': 'req-b371198e-9372-4b6b-bfac-209e5950c188'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.474455 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30ecf0f8ce443b7b8312189380afacd', 'request_id': 'req-b371198e-9372-4b6b-bfac-209e5950c188'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.486583 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] The token cache is being invalidate because project d30ecf0f8ce443b7b8312189380afacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:25.486876 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.487535 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.489284 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1466/2906] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:25 2022] DELETE /identity/v3/projects/d30ecf0f8ce443b7b8312189380afacd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:25.493325 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:25.503243 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacccc79-f9d1-4a82-bf86-e940c2bde121 service neutron] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:25.559482 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:25.560341 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:25.560629 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:25.560911 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] PATH_INFO: `/v3/users/28cbf49d703d417fbb74b3221e8fde9b` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:25.562168 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cbf49d703d417fbb74b3221e8fde9b)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:25.564121 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:25.565611 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:25.812822 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cbf49d703d417fbb74b3221e8fde9b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.825027 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cbf49d703d417fbb74b3221e8fde9b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.831827 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cbf49d703d417fbb74b3221e8fde9b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.832498 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cbf49d703d417fbb74b3221e8fde9b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.833107 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cbf49d703d417fbb74b3221e8fde9b'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:25.934478 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1441/2907] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:57:25 2022] DELETE /identity/v3/users/28cbf49d703d417fbb74b3221e8fde9b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:26.412054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:26.413566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:26.427054 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b371198e-9372-4b6b-bfac-209e5950c188 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:26.480847 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:26.486641 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:26.487701 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:26.488128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:26.488418 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] PATH_INFO: `/v3/projects/5d91248961fd4e1b96ba6bed200aafd1` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:26.489585 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d91248961fd4e1b96ba6bed200aafd1)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:26.492164 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:26.598940 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d91248961fd4e1b96ba6bed200aafd1', 'request_id': 'req-14e5fb1c-b761-4b18-994b-cc59bcb58d41'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:26.605006 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d91248961fd4e1b96ba6bed200aafd1', 'request_id': 'req-14e5fb1c-b761-4b18-994b-cc59bcb58d41'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:26.696545 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d91248961fd4e1b96ba6bed200aafd1', 'request_id': 'req-14e5fb1c-b761-4b18-994b-cc59bcb58d41'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:26.707417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] The token cache is being invalidate because project 5d91248961fd4e1b96ba6bed200aafd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:57:26.707703 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:26.708370 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:57:26.709987 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1467/2908] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:57:26 2022] DELETE /identity/v3/projects/5d91248961fd4e1b96ba6bed200aafd1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:57:35.930769 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:36.748502 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:48.141295 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:48.143039 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:48.148082 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:57:48.149484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:48.220759 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6127cd3-e8cc-4a11-a276-ac416bf4657b admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:48.229635 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e5fb1c-b761-4b18-994b-cc59bcb58d41 admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:57:48.235649 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:48.237737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:48.237737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:48.237737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:48.239070 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:48.253735 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:48.255647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:48.268647 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1468/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:57:48.291254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:57:48.291906 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:57:48.292193 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:57:48.292467 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:57:48.294284 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:57:48.307232 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:57:48.309108 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:57:48.320377 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1442/2910] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:57:58.262245 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=32 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:57:58.315060 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=62 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:27.552343 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:27.553782 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:27.656172 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80041f0-a8bc-4156-80a0-517176f135bd service placement] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:27.659806 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:27.665574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:27.665574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:27.665574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:27.665574 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:27.734005 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:27.735466 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:27.745316 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1469/2911] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:59:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:59:28.638534 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:28.639850 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:28.742861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203df5d-5130-4eff-9105-d8286cd6fdee service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:28.748526 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99eac0e91e884f4c8e1c93f7f66d43a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:28.749174 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:28.749465 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:28.749745 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:28.751986 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:28.766715 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:28.768342 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:28.779371 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1443/2912] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 03:59:32.856309 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:32.865744 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea186620-2f75-4568-9941-7f7e01e15f1c service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:32.869447 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '05b58dde8d4a426ead9dda4363cb82a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:32.870128 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:32.870417 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:32.870698 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:32.872470 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:32.925040 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=100 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:32.956873 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:32.958397 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:32.978675 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1470/2913] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 03:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 03:59:38.774755 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=40 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:39.884919 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:39.886626 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:39.901542 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e938ba4-74cf-4744-87e6-ee5ccf91302d service nova] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:39.906430 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:39.907291 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:39.907579 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:39.907857 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] PATH_INFO: `/v3/users/fcbcadf4140646abb8969fc69f17fba1` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:39.909042 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbcadf4140646abb8969fc69f17fba1)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:39.911664 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:40.126858 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbcadf4140646abb8969fc69f17fba1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.139450 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbcadf4140646abb8969fc69f17fba1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.146254 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbcadf4140646abb8969fc69f17fba1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.146921 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbcadf4140646abb8969fc69f17fba1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.147521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbcadf4140646abb8969fc69f17fba1'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.218416 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1444/2914] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:59:39 2022] DELETE /identity/v3/users/fcbcadf4140646abb8969fc69f17fba1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:59:40.698327 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:40.709178 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139a19b-e883-46f4-8e1c-e87ba4708c9a service neutron] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:40.773281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:40.773281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:40.773281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:40.773281 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] PATH_INFO: `/v3/projects/954726a4f5af427993e6d6c4f4869988` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:40.773918 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=954726a4f5af427993e6d6c4f4869988)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:40.774655 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:40.894898 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954726a4f5af427993e6d6c4f4869988', 'request_id': 'req-da7235e2-c3cc-47ac-aa36-0aea103baf0e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.901123 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954726a4f5af427993e6d6c4f4869988', 'request_id': 'req-da7235e2-c3cc-47ac-aa36-0aea103baf0e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.987593 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954726a4f5af427993e6d6c4f4869988', 'request_id': 'req-da7235e2-c3cc-47ac-aa36-0aea103baf0e'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.999308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] The token cache is being invalidate because project 954726a4f5af427993e6d6c4f4869988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:59:40.999308 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:40.999849 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.001439 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1471/2915] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:59:40 2022] DELETE /identity/v3/projects/954726a4f5af427993e6d6c4f4869988 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:59:41.005521 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:41.006955 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:41.020971 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a0276-385f-4e86-9bc7-44c60086f7a8 admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:41.076447 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:41.077308 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:41.077587 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:41.077904 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] PATH_INFO: `/v3/users/995aadfdfa734c38b5837f2681487963` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:41.079095 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] RBAC: Authorizing `identity:delete_user(user_id=995aadfdfa734c38b5837f2681487963)` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:41.080982 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:41.280344 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '995aadfdfa734c38b5837f2681487963'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.291861 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '995aadfdfa734c38b5837f2681487963'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.298551 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '995aadfdfa734c38b5837f2681487963'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.299203 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '995aadfdfa734c38b5837f2681487963'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.299801 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.notifications [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '995aadfdfa734c38b5837f2681487963'} {{(pid=80791) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.301441 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:41.381365 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1445/2916] 10.222.0.42 () {58 vars in 1223 bytes} [Fri Jun 24 03:59:41 2022] DELETE /identity/v3/users/995aadfdfa734c38b5837f2681487963 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:59:41.645737 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Authenticating user token {{(pid=80792) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 03:59:41.647993 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.fernet_utils [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80792) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 03:59:41.662946 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7235e2-c3cc-47ac-aa36-0aea103baf0e admin admin] Validating token access rules against request {{(pid=80792) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 03:59:41.711441 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:41.723612 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2caa6cb9210e46f2a79af594aec8b818', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc8d9d26aed04d1b8b0e31128b902112', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80792) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 03:59:41.724484 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 03:59:41.724762 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 03:59:41.728528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] PATH_INFO: `/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64` {{(pid=80792) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 03:59:41.728528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f5576fc9fa465c8e8e09ba8b993b64)` {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 03:59:41.728528 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] RBAC: Authorization granted {{(pid=80792) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 03:59:41.833582 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f5576fc9fa465c8e8e09ba8b993b64', 'request_id': 'req-52812272-5a51-4cd2-811c-981f1cf41c06'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.839652 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f5576fc9fa465c8e8e09ba8b993b64', 'request_id': 'req-52812272-5a51-4cd2-811c-981f1cf41c06'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.921566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f5576fc9fa465c8e8e09ba8b993b64', 'request_id': 'req-52812272-5a51-4cd2-811c-981f1cf41c06'} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.932566 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] The token cache is being invalidate because project 17f5576fc9fa465c8e8e09ba8b993b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80792) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 03:59:41.932856 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.933489 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG keystone.notifications [None req-52812272-5a51-4cd2-811c-981f1cf41c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80792) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 03:59:41.935092 dv-cinder-846842-3-smb devstack@keystone.service[80792]: [pid: 80792|app: 0|req: 1472/2917] 10.222.0.42 () {58 vars in 1232 bytes} [Fri Jun 24 03:59:41 2022] DELETE /identity/v3/projects/17f5576fc9fa465c8e8e09ba8b993b64 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 03:59:51.515682 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 03:59:51.929273 dv-cinder-846842-3-smb devstack@keystone.service[80792]: DEBUG dbcounter [-] [80792] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80792) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 04:00:08.950849 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Authenticating user token {{(pid=80791) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 04:00:08.952256 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 04:00:09.044680 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9b28f-e76c-428d-9af4-dfedcda9cabd admin admin] Validating token access rules against request {{(pid=80791) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 04:00:09.103054 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e33b3d4866d04b0095739952e76255c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9ae89c41e0043cf9cf363c3f81dd53c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80791) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 04:00:09.103704 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] REQUEST_METHOD: `GET` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 04:00:09.104020 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] SCRIPT_NAME: `/identity` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 04:00:09.104298 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80791) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 04:00:09.106111 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.fernet_utils [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80791) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 04:00:09.117968 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 04:00:09.125273 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38701cad-3e87-4510-9388-865d33e6a030 service placement] RBAC: Authorization granted {{(pid=80791) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 04:00:09.129724 dv-cinder-846842-3-smb devstack@keystone.service[80791]: [pid: 80791|app: 0|req: 1446/2918] 10.222.0.42 () {60 vars in 1365 bytes} [Fri Jun 24 04:00:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 04:00:19.125136 dv-cinder-846842-3-smb devstack@keystone.service[80791]: DEBUG dbcounter [-] [80791] Writing DB stats keystone:SELECT=67 {{(pid=80791) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}